Apr 13 17:37:43 devstack cinder-volume[73082]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 17:37:43 devstack cinder-volume[73082]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:37:43 devstack cinder-volume[73082]: we strongly recommend against using it for new projects. Apr 13 17:37:43 devstack cinder-volume[73082]: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:37:43 devstack cinder-volume[73082]: framework. For more detail see Apr 13 17:37:43 devstack cinder-volume[73082]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:37:43 devstack cinder-volume[73082]: import eventlet # noqa Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73082) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73082) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73082) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:37:45 devstack cinder-volume[73082]: INFO dbcounter [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Registered counter for database cinder Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG oslo_db.sqlalchemy.engines [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG dbcounter [-] [73082] Writer thread running {{(pid=73082) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:37:45 devstack cinder-volume[73082]: INFO cinder.rpc [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 17:37:45 devstack cinder-volume[73082]: INFO cinder.rpc [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG oslo_db.sqlalchemy.engines [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:37:45 devstack cinder-volume[73082]: INFO cinder.volume.manager [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Determined volume DB was empty at startup. Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG cinder.volume.manager [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73082) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 17:37:45 devstack cinder-volume[73082]: INFO cinder.volume.manager [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 17:37:45 devstack cinder-volume[73082]: WARNING stevedore.named [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 17:37:45 devstack cinder-volume[73082]: WARNING castellan.key_manager [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:37:45 devstack cinder-volume[73082]: WARNING cinder.keymgr.conf_key_mgr [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG cinder.volume.drivers.lvm [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73082) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 13 17:37:45 devstack cinder-volume[73082]: DEBUG oslo_concurrency.processutils [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73082) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_concurrency.processutils [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] CMD "cinder-rtstool verify" returned: 0 in 0.230s {{(pid=73082) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_db.sqlalchemy.engines [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:37:46 devstack cinder-volume[73082]: INFO cinder.rpc [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 13 17:37:46 devstack cinder-volume[73082]: INFO cinder.rpc [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 13 17:37:46 devstack cinder-volume[73082]: WARNING stevedore.named [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 17:37:46 devstack cinder-volume[73082]: WARNING castellan.key_manager [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:37:46 devstack cinder-volume[73082]: INFO cinder.volume.manager [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_db.sqlalchemy.engines [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:37:46 devstack cinder-volume[73082]: INFO oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Starting 1 workers Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Started child 73187 {{(pid=73082) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Full set of CONF: {{(pid=73082) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] ******************************************************************************** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Configuration options gathered from: {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] ================================================================================ {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] allow_availability_zone_fallback = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] allow_compression_on_image_upload = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] allowed_direct_url_schemes = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] api_rate_limit = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73187]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] auth_strategy = keystone {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] az_cache_duration = 3600 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_availability_zone = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_host = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_stats_polling_interval = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backup_api_class = cinder.backup.api.API {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backup_name_template = backup-%s {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backup_use_same_host = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backup_use_temp_snapshot = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] chap_password = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] chap_username = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_internal_tenant_project_id = 585d10f4e738498cbe1d19693839f4e2 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_internal_tenant_user_id = 61fa68109e2c46878bcf71573a30ddc5 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cloned_volume_same_az = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cluster = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] compression_format = gzip {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] compute_api_class = cinder.compute.nova.API {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] config_dir = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] config_source = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] control_exchange = openstack {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] debug = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] default_availability_zone = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] default_group_type = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] default_volume_type = lvmdriver-1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] disk_geometry = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] driver_client_cert = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] driver_client_cert_key = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] driver_data_namespace = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] driver_ssl_cert_path = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] driver_ssl_cert_verify = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] driver_use_ssl = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] enable_force_upload = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] enable_new_services = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] enable_unsupported_driver = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] enabled_backends = ['lvmdriver-1'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] enforce_multipath_for_image_xfer = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] filter_function = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_api_insecure = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_api_servers = ['http://192.168.122.108/image'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_api_ssl_compression = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_ca_certificates_file = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_catalog_info = image:glance:publicURL {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_certfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_keyfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_num_retries = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance_request_timeout = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] goodness_function = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] graceful_shutdown_timeout = 5 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] group_api_class = cinder.group.api.API {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] host = devstack {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_compress_on_upload = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_conversion_address_space_limit = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_conversion_cpu_limit = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_conversion_disable = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_upload_use_cinder_backend = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_upload_use_internal_tenant = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_volume_cache_enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_volume_cache_max_count = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] image_volume_cache_max_size_gb = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] init_host_max_objects_retrieval = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] instance_format = [instance: %(uuid)s] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] iscsi_target_flags = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] iscsi_write_cache = on {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] iser_helper = tgtadm {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] iser_ip_address = 192.168.122.108 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] iser_port = 3260 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_color = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_config_append = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_dir = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_file = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_options = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_rotate_interval = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_rotate_interval_type = days {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] log_rotation_type = none {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] max_age = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] max_logfile_count = 30 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] max_logfile_size_mb = 200 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] max_over_subscription_ratio = 20.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] message_reap_interval = 86400 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] message_ttl = 2592000 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] migration_create_volume_timeout_secs = 300 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] monkey_patch = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] monkey_patch_modules = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] my_ip = 192.168.122.108 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] no_snapshot_gb_quota = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] num_iser_scan_tries = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] num_shell_tries = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] num_volume_device_scan_tries = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] nvmeof_conn_info_version = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] nvmet_ns_id = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] nvmet_port_id = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] osapi_max_limit = 1000 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] osapi_volume_ext_list = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] osapi_volume_listen = 0.0.0.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] osapi_volume_listen_port = 8776 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] osapi_volume_use_ssl = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] osapi_volume_workers = 2 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] per_volume_size_limit = -1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] periodic_fuzzy_delay = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] periodic_interval = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] project_id_regex = [0-9a-f\-]+ {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] public_endpoint = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] publish_errors = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] quota_backup_gigabytes = 1000 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] quota_backups = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] quota_gigabytes = 1000 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] quota_groups = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] quota_snapshots = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] quota_volumes = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] rate_limit_burst = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] rate_limit_except_level = CRITICAL {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] rate_limit_interval = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73187]: INFO cinder.volume.manager [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] reinit_driver_count = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] replication_device = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] report_discard_supported = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] report_interval = 120 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] reservation_clean_interval = 86400 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] reservation_expire = 86400 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] reserved_image_namespaces = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] reserved_percentage = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] rpc_response_timeout = 120 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] run_external_periodic_tasks = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] scst_target_driver = iscsi {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] scst_target_iqn_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_down_time = 720 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] shell_completion = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] snapshot_name_template = snapshot-%s {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] snapshot_same_host = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] split_loggers = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] state_path = /opt/stack/data/cinder {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] storage_availability_zone = nova {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] storage_protocol = iSCSI {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] syslog_log_facility = LOG_USER {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] target_helper = lioadm {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] target_ip_address = 192.168.122.108 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] target_port = 3260 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] target_protocol = iscsi {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] target_secondary_ip_addresses = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] trace_flags = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] transfer_api_class = cinder.transfer.api.API {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] transport_url = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] until_refresh = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] use_chap_auth = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] use_default_quota_class = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] use_journal = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] use_json = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] use_multipath_for_image_xfer = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] use_stderr = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] use_syslog = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] verify_glance_signatures = enabled {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_api_class = cinder.volume.api.API {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_backend_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_clear = zero {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_clear_ionice = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_clear_size = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_copy_bps_limit = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_dd_blocksize = 1M {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_name_template = volume-%s {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_service_inithost_offload = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volume_usage_audit_period = month {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] zoning_mode = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_concurrency.disable_process_locking = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.admin_password = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.admin_token = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.admin_user = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.auth_admin_prefix = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.auth_port = 35357 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.auth_protocol = https {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.auth_section = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.auth_type = password {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.auth_uri = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.auth_version = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.cache = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.certfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.delay_auth_decision = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.http_connect_timeout = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.identity_uri = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.include_service_catalog = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.insecure = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.interface = public {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.keyfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_password = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcache_username = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.region_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.service_token_roles_required = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.service_type = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.token_cache_time = 300 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.108/identity {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.backend = dogpile.cache.null {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.backend_argument = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.backend_expiration_time = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.config_prefix = cache.oslo {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.debug_cache_backend = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.enable_retry_client = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.enable_socket_keepalive = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.enforce_fips_mode = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.expiration_time = 600 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.hashclient_retry_attempts = 2 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.memcache_dead_retry = 300 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.memcache_pool_maxsize = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.memcache_sasl_enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.password = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.proxies = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.redis_db = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.redis_sentinel_service_name = mymaster {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.redis_server = localhost:6379 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.retry_attempts = 2 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.retry_delay = 0.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.socket_keepalive_count = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.socket_keepalive_idle = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.socket_keepalive_interval = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.socket_timeout = 1.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.tls_allowed_ciphers = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.tls_cafile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.tls_certfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.tls_enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.tls_keyfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cache.username = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] coordination.backend_url = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.asyncio_connection = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.asyncio_slave_connection = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.backend = sqlalchemy {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.connection = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.connection_debug = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.connection_parameters = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.connection_recycle_time = 3600 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.connection_trace = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.db_inc_retry_interval = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.db_max_retries = 20 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.db_max_retry_interval = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.db_retry_interval = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.max_overflow = 50 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.max_pool_size = 5 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.max_retries = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.mysql_wsrep_sync_wait = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.pool_timeout = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.retry_interval = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.slave_connection = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.sqlite_synchronous = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.synchronous_reader = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] database.use_db_reconnect = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.connection_string = messaging:// {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.es_doc_type = notification {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.es_scroll_size = 10000 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.es_scroll_time = 2m {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.filter_error_trace = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.hmac_keys = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.sentinel_service_name = mymaster {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.socket_timeout = 0.1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.trace_requests = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler.trace_sqlalchemy = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler_jaeger.process_tags = {} {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler_jaeger.service_name_prefix = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] profiler_otlp.service_name_prefix = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.enforce_new_defaults = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: WARNING oslo_config.cfg [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.enforce_scope = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.policy_default_rule = default {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.policy_file = policy.yaml {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_policy.remote_timeout = 60.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] privsep_osbrick.group = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] privsep_osbrick.helper_command = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] privsep_osbrick.user = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_sys_admin.group = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_sys_admin.helper_command = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] cinder_sys_admin.user = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.auth_section = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.auth_type = password {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.cafile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.certfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.collect_timing = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.insecure = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.keyfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.send_service_user_token = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.split_loggers = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] service_user.timeout = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.auth_section = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.auth_type = password {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.certfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.collect_timing = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.insecure = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.keyfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.region_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.split_loggers = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] glance.timeout = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.backend_availability_zone = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.chap_password = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.chap_username = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.disk_geometry = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.driver_client_cert = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.driver_client_cert_key = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.driver_data_namespace = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.driver_use_ssl = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.enable_unsupported_driver = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.extra_capabilities = {} {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.filter_function = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.goodness_function = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.iscsi_target_flags = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.iscsi_write_cache = on {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.iser_helper = tgtadm {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.iser_ip_address = 192.168.122.108 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.iser_port = 3260 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.lvm_mirrors = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.lvm_share_target = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.lvm_type = auto {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.num_shell_tries = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.nvmet_port_id = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.replication_device = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.report_discard_supported = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.reserved_percentage = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.scst_target_driver = iscsi {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.scst_target_iqn_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.storage_protocol = iSCSI {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.target_helper = tgtadm {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.target_ip_address = 192.168.122.108 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.target_port = 3260 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.target_protocol = iscsi {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.trace_flags = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.unique_fqdn_network = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.use_chap_auth = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_backend_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_clear = zero {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_clear_ionice = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_clear_size = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volume_group = cinder-volumes {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_reports.file_event_handler = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_reports.log_dir = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.backend_availability_zone = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.backend_host = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.chap_password = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.chap_username = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.chiscsi_conf = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.disk_geometry = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.driver_client_cert = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.driver_data_namespace = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.driver_use_ssl = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.extra_capabilities = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.filter_function = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.goodness_function = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.iser_helper = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.iser_ip_address = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.iser_port = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.iser_target_prefix = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.lvm_conf_file = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.lvm_mirrors = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.lvm_share_target = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.lvm_type = auto {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.num_shell_tries = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.nvmet_port_id = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.replication_device = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.report_discard_supported = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.reserved_percentage = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.scst_target_driver = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.storage_protocol = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.target_helper = lioadm {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.target_ip_address = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.target_port = 3260 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.target_protocol = iscsi {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.trace_flags = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.use_chap_auth = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_clear = zero {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_clear_size = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] lvmdriver-1.volumes_dir = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.ssl = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.ssl_version = {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_notifications.driver = [] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_notifications.retry = -1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] oslo_messaging_notifications.transport_url = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] key_manager.fixed_key = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.barbican_api_version = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.barbican_endpoint = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.barbican_endpoint_type = public {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.barbican_region_name = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.cafile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.certfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.collect_timing = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.insecure = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.keyfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.number_of_retries = 60 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.retry_delay = 1 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.send_service_user_token = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.split_loggers = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.timeout = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.verify_ssl = True {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican.verify_ssl_path = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.auth_section = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.auth_type = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.cafile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.certfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.collect_timing = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.insecure = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.keyfile = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.split_loggers = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] barbican_service_user.timeout = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.approle_role_id = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.approle_secret_id = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.kv_mountpoint = secret {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.kv_path = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.kv_version = 2 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.namespace = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.root_token_id = **** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.ssl_ca_crt_file = None {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.timeout = 60.0 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.use_ssl = False {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:37:46 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] ******************************************************************************** {{(pid=73082) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 17:37:46 devstack sudo[73191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 13 17:37:46 devstack sudo[73191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:46 devstack sudo[73191]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:46 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:46 devstack sudo[73410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:46 devstack sudo[73410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:47 devstack sudo[73410]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:47 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.541s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:47 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:37:47 devstack cinder-volume[73187]: INFO cinder.brick.local_dev.lvm [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 13 17:37:47 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:47 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:47 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:47 devstack sudo[73648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:37:47 devstack sudo[73648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:47 devstack sudo[73648]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:47 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:47 devstack cinder-volume[73187]: DEBUG cinder.brick.local_dev.lvm [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73187) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 13 17:37:47 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:47 devstack sudo[73714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:47 devstack sudo[73714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:48 devstack sudo[73714]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:48 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.765s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:48 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:48 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:48 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:48 devstack sudo[73875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:48 devstack sudo[73875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:49 devstack sudo[73875]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:49 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:49 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:49 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:49 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:49 devstack sudo[73883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 13 17:37:49 devstack sudo[73883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:49 devstack sudo[73883]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:49 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.482s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:49 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:49 devstack sudo[73886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:37:49 devstack sudo[73886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:50 devstack sudo[73886]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:50 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:50 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:50 devstack sudo[73891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:37:50 devstack sudo[73891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:50 devstack sudo[73891]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:50 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.533s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:50 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:50 devstack sudo[73896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:37:50 devstack sudo[73896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:51 devstack sudo[73896]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:51 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:51 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:51 devstack sudo[73902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:51 devstack sudo[73902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:51 devstack sudo[73902]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:51 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:51 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:51 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:51 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:51 devstack sudo[73912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:51 devstack sudo[73912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:52 devstack sudo[73912]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:52 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.562s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:52 devstack cinder-volume[73187]: INFO cinder.volume.drivers.lvm [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 13 17:37:52 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:52 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.010s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:52 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:52 devstack sudo[74025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:52 devstack sudo[74025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:52 devstack sudo[74025]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:52 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:52 devstack cinder-volume[73187]: DEBUG cinder.volume.drivers.lvm [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Updating volume stats {{(pid=73187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:37:52 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:52 devstack sudo[74098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:37:52 devstack sudo[74098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:53 devstack sudo[74098]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:53 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:53 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:53 devstack sudo[74170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:37:53 devstack sudo[74170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:53 devstack sudo[74170]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:53 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:53 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:53 devstack sudo[74173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:53 devstack sudo[74173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:54 devstack sudo[74173]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:54 devstack sudo[74176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:37:54 devstack sudo[74176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:54 devstack sudo[74176]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:54 devstack cinder-volume[73187]: INFO cinder.volume.driver [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Driver hasn't implemented _init_vendor_properties() Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG cinder.volume.driver [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73187) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG oslo_db.sqlalchemy.engines [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG dbcounter [-] [73187] Writer thread running {{(pid=73187) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG cinder.db.sqlalchemy.api [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Building query based on filter {{(pid=73187) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG cinder.image.image_utils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73187) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 17:37:54 devstack cinder-volume[73187]: INFO cinder.keymgr.migration [None req-ee7d6ddd-a0a7-4a91-9601-1f418aa9938b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG cinder.volume.drivers.lvm [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Updating volume stats {{(pid=73187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:37:54 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:54 devstack sudo[74182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:37:54 devstack sudo[74182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:55 devstack sudo[74182]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:55 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:55 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:55 devstack sudo[74188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:37:55 devstack sudo[74188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:55 devstack sudo[74188]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:55 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:55 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:55 devstack sudo[74193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:55 devstack sudo[74193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:56 devstack sudo[74193]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:56 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:56 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:56 devstack cinder-volume[73082]: DEBUG dbcounter [-] [73082] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73082) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:37:56 devstack sudo[74198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:37:56 devstack sudo[74198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:56 devstack sudo[74198]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:56 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:56 devstack cinder-volume[73187]: DEBUG cinder.manager [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Notifying Schedulers of capabilities ... {{(pid=73187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:37:56 devstack cinder-volume[73187]: INFO cinder.volume.manager [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Driver initialization completed successfully. Apr 13 17:37:56 devstack cinder-volume[73187]: INFO cinder.manager [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Initiating service 2 cleanup Apr 13 17:37:56 devstack cinder-volume[73187]: INFO cinder.manager [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Service 2 cleanup completed. Apr 13 17:37:56 devstack cinder-volume[73187]: DEBUG cinder.service [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Creating RPC server for service cinder-volume {{(pid=73187) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 17:37:56 devstack cinder-volume[73187]: DEBUG cinder.service [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73187) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 17:37:56 devstack cinder-volume[73187]: INFO cinder.volume.manager [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 13 17:37:56 devstack cinder-volume[73187]: DEBUG cinder.volume.drivers.lvm [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Updating volume stats {{(pid=73187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:37:56 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:56 devstack sudo[74203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:37:56 devstack sudo[74203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:57 devstack sudo[74203]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:57 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:57 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:57 devstack sudo[74263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:37:57 devstack sudo[74263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:57 devstack sudo[74263]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:57 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:57 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:57 devstack sudo[74266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:37:57 devstack sudo[74266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:57 devstack sudo[74266]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:57 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.408s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:57 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:37:57 devstack sudo[74269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:37:57 devstack sudo[74269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:37:58 devstack sudo[74269]: pam_unix(sudo:session): session closed for user root Apr 13 17:37:58 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:37:58 devstack cinder-volume[73187]: INFO cinder.volume.manager [None req-d1b8b324-a999-44a5-85d3-f22dab1fa0bc None None] Driver post RPC initialization completed successfully. Apr 13 17:38:08 devstack cinder-volume[73187]: DEBUG dbcounter [-] [73187] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73187) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:38:08 devstack cinder-volume[73187]: DEBUG dbcounter [-] [73187] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73187) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:39:30 devstack cinder-volume[73187]: DEBUG oslo_service.periodic_task [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73187) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:39:30 devstack cinder-volume[73187]: DEBUG cinder.volume.drivers.lvm [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Updating volume stats {{(pid=73187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:39:30 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:39:30 devstack sudo[79268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:39:30 devstack sudo[79268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:39:30 devstack sudo[79268]: pam_unix(sudo:session): session closed for user root Apr 13 17:39:30 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:39:30 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:39:30 devstack sudo[79271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:39:30 devstack sudo[79271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:39:31 devstack sudo[79271]: pam_unix(sudo:session): session closed for user root Apr 13 17:39:31 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:39:31 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:39:31 devstack sudo[79274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:39:31 devstack sudo[79274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:39:31 devstack sudo[79274]: pam_unix(sudo:session): session closed for user root Apr 13 17:39:31 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:39:31 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:39:31 devstack sudo[79277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:39:31 devstack sudo[79277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:39:32 devstack sudo[79277]: pam_unix(sudo:session): session closed for user root Apr 13 17:39:32 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:39:32 devstack cinder-volume[73187]: DEBUG cinder.manager [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Notifying Schedulers of capabilities ... {{(pid=73187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:40:08 devstack cinder-volume[73187]: DEBUG dbcounter [-] [73187] Writing DB stats cinder:SELECT=1 {{(pid=73187) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:40:08 devstack cinder-volume[73187]: DEBUG dbcounter [-] [73187] Writing DB stats cinder:UPDATE=1 {{(pid=73187) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:40:30 devstack cinder-volume[73187]: DEBUG oslo_service.periodic_task [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73187) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:40:30 devstack cinder-volume[73187]: DEBUG cinder.volume.drivers.lvm [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Updating volume stats {{(pid=73187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 17:40:30 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:40:30 devstack sudo[81288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 17:40:30 devstack sudo[81288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:40:30 devstack sudo[81288]: pam_unix(sudo:session): session closed for user root Apr 13 17:40:30 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:40:30 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:40:30 devstack sudo[81292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:40:30 devstack sudo[81292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:40:31 devstack sudo[81292]: pam_unix(sudo:session): session closed for user root Apr 13 17:40:31 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:40:31 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:40:31 devstack sudo[81296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 17:40:31 devstack sudo[81296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:40:31 devstack sudo[81296]: pam_unix(sudo:session): session closed for user root Apr 13 17:40:31 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:40:31 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:40:31 devstack sudo[81310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 17:40:31 devstack sudo[81310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:40:32 devstack sudo[81310]: pam_unix(sudo:session): session closed for user root Apr 13 17:40:32 devstack cinder-volume[73187]: DEBUG oslo_concurrency.processutils [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=73187) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:40:32 devstack cinder-volume[73187]: DEBUG cinder.manager [None req-ee404caf-11ec-442a-acaa-785ab7ff416f None None] Notifying Schedulers of capabilities ... {{(pid=73187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:41:08 devstack cinder-volume[73082]: INFO oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Caught SIGTERM, stopping children Apr 13 17:41:08 devstack cinder-volume[73082]: DEBUG oslo_concurrency.lockutils [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Acquiring lock "singleton_lock" {{(pid=73082) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:41:08 devstack cinder-volume[73082]: DEBUG oslo_concurrency.lockutils [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Acquired lock "singleton_lock" {{(pid=73082) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:41:08 devstack cinder-volume[73082]: DEBUG oslo_concurrency.lockutils [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Releasing lock "singleton_lock" {{(pid=73082) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:41:08 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Stop services. {{(pid=73082) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 17:41:08 devstack cinder-volume[73082]: DEBUG oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Killing children. {{(pid=73082) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 17:41:08 devstack cinder-volume[73082]: INFO oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Waiting on 1 children to exit Apr 13 17:41:11 devstack cinder-volume[73187]: DEBUG oslo_concurrency.lockutils [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Acquiring lock "singleton_lock" {{(pid=73187) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:41:11 devstack cinder-volume[73187]: DEBUG oslo_concurrency.lockutils [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Acquired lock "singleton_lock" {{(pid=73187) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:41:11 devstack cinder-volume[73187]: DEBUG oslo_concurrency.lockutils [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Releasing lock "singleton_lock" {{(pid=73187) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:41:11 devstack cinder-volume[73187]: WARNING amqp [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 17:41:11 devstack cinder-volume[73187]: WARNING amqp [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 17:41:11 devstack cinder-volume[73082]: INFO oslo_service.backend._eventlet.service [None req-f8eef662-f425-4d96-a418-2c5c76e2e61d None None] Child 73187 exited with status 0 Apr 13 17:41:11 devstack cinder-volume[82224]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 17:41:11 devstack cinder-volume[82224]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:41:11 devstack cinder-volume[82224]: we strongly recommend against using it for new projects. Apr 13 17:41:11 devstack cinder-volume[82224]: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:41:11 devstack cinder-volume[82224]: framework. For more detail see Apr 13 17:41:11 devstack cinder-volume[82224]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:41:11 devstack cinder-volume[82224]: import eventlet # noqa Apr 13 17:41:13 devstack cinder-volume[82224]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82224) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:41:13 devstack cinder-volume[82224]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82224) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:41:13 devstack cinder-volume[82224]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82224) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:41:14 devstack cinder-volume[82224]: INFO dbcounter [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Registered counter for database cinder Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_db.sqlalchemy.engines [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG dbcounter [-] [82224] Writer thread running {{(pid=82224) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:41:14 devstack cinder-volume[82224]: INFO cinder.rpc [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 17:41:14 devstack cinder-volume[82224]: INFO cinder.rpc [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_db.sqlalchemy.engines [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:41:14 devstack cinder-volume[82224]: INFO cinder.volume.manager [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Determined volume DB was empty at startup. Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG cinder.volume.manager [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82224) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 17:41:14 devstack cinder-volume[82224]: INFO cinder.volume.manager [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 17:41:14 devstack cinder-volume[82224]: WARNING stevedore.named [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 17:41:14 devstack cinder-volume[82224]: WARNING castellan.key_manager [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:41:14 devstack cinder-volume[82224]: WARNING cinder.keymgr.conf_key_mgr [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:41:14 devstack cinder-volume[82224]: INFO cinder.volume.manager [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_db.sqlalchemy.engines [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:41:14 devstack cinder-volume[82224]: INFO oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Starting 1 workers Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Started child 82339 {{(pid=82224) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Full set of CONF: {{(pid=82224) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] ******************************************************************************** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Configuration options gathered from: {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] ================================================================================ {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] allow_availability_zone_fallback = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] allow_compression_on_image_upload = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] allowed_direct_url_schemes = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] api_rate_limit = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] auth_strategy = keystone {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_availability_zone = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_host = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_stats_polling_interval = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backup_api_class = cinder.backup.api.API {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backup_name_template = backup-%s {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backup_use_same_host = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backup_use_temp_snapshot = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] chap_password = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] chap_username = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_internal_tenant_project_id = 585d10f4e738498cbe1d19693839f4e2 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_internal_tenant_user_id = 61fa68109e2c46878bcf71573a30ddc5 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cluster = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] compression_format = gzip {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] compute_api_class = cinder.compute.nova.API {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] config_dir = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] config_source = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] control_exchange = openstack {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] debug = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] default_availability_zone = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] default_group_type = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] default_volume_type = QuobyteHD {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] disk_geometry = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] driver_client_cert = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] driver_client_cert_key = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] driver_data_namespace = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] driver_ssl_cert_path = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] driver_ssl_cert_verify = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] driver_use_ssl = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82339]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] enable_new_services = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] enable_unsupported_driver = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] enabled_backends = ['QuobyteHD'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] enforce_multipath_for_image_xfer = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] filter_function = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_api_insecure = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_api_servers = ['http://192.168.122.108/image'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_api_ssl_compression = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_ca_certificates_file = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_catalog_info = image:glance:publicURL {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_certfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_keyfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_num_retries = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance_request_timeout = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] goodness_function = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] graceful_shutdown_timeout = 5 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] group_api_class = cinder.group.api.API {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] host = devstack {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_compress_on_upload = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_conversion_address_space_limit = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_conversion_cpu_limit = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_conversion_disable = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_upload_use_cinder_backend = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_upload_use_internal_tenant = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_volume_cache_enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_volume_cache_max_count = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] image_volume_cache_max_size_gb = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] init_host_max_objects_retrieval = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] instance_format = [instance: %(uuid)s] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] iscsi_target_flags = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] iscsi_write_cache = on {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] iser_helper = tgtadm {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] iser_ip_address = 192.168.122.108 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] iser_port = 3260 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_color = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_config_append = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_dir = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_file = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_options = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_rotate_interval = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_rotate_interval_type = days {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] log_rotation_type = none {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] max_age = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] max_logfile_count = 30 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] max_logfile_size_mb = 200 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] max_over_subscription_ratio = 20.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] message_reap_interval = 86400 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] message_ttl = 2592000 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] migration_create_volume_timeout_secs = 300 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] monkey_patch = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] monkey_patch_modules = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] my_ip = 192.168.122.108 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] no_snapshot_gb_quota = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] num_iser_scan_tries = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] num_shell_tries = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] num_volume_device_scan_tries = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] nvmeof_conn_info_version = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] nvmet_ns_id = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] nvmet_port_id = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] osapi_max_limit = 1000 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] osapi_volume_ext_list = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] osapi_volume_listen = 0.0.0.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] osapi_volume_listen_port = 8776 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] osapi_volume_use_ssl = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82339]: INFO cinder.volume.manager [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 17:41:14 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.remotefs [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82339) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] osapi_volume_workers = 2 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] per_volume_size_limit = -1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] periodic_fuzzy_delay = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] periodic_interval = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] project_id_regex = [0-9a-f\-]+ {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] public_endpoint = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] publish_errors = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] quota_backup_gigabytes = 1000 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] quota_backups = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] quota_gigabytes = 1000 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] quota_groups = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] quota_snapshots = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] quota_volumes = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] rate_limit_burst = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] rate_limit_except_level = CRITICAL {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] rate_limit_interval = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] reinit_driver_count = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] replication_device = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] report_discard_supported = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] report_interval = 120 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] reservation_clean_interval = 86400 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] reservation_expire = 86400 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] reserved_image_namespaces = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] reserved_percentage = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] rpc_response_timeout = 120 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] run_external_periodic_tasks = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] scst_target_driver = iscsi {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] scst_target_iqn_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_down_time = 720 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] shell_completion = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] snapshot_name_template = snapshot-%s {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] split_loggers = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] state_path = /opt/stack/data/cinder {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] storage_availability_zone = nova {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] storage_protocol = iSCSI {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] syslog_log_facility = LOG_USER {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] target_helper = lioadm {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] target_ip_address = 192.168.122.108 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] target_port = 3260 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] target_protocol = iscsi {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] target_secondary_ip_addresses = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] trace_flags = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] transfer_api_class = cinder.transfer.api.API {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] transport_url = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] until_refresh = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] use_chap_auth = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] use_default_quota_class = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] use_journal = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] use_json = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] use_multipath_for_image_xfer = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] use_stderr = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] use_syslog = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] verify_glance_signatures = enabled {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_api_class = cinder.volume.api.API {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_backend_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_clear = zero {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_clear_ionice = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_clear_size = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_copy_bps_limit = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_dd_blocksize = 1M {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_name_template = volume-%s {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_service_inithost_offload = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volume_usage_audit_period = month {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] zoning_mode = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_concurrency.disable_process_locking = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.admin_password = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.admin_token = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.admin_user = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.auth_admin_prefix = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.auth_port = 35357 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.auth_protocol = https {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.auth_section = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.auth_type = password {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.auth_uri = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.auth_version = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.cache = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.certfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.delay_auth_decision = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.http_connect_timeout = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.identity_uri = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.include_service_catalog = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.insecure = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.interface = public {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.keyfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_password = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcache_username = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.region_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.service_token_roles_required = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.service_type = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.token_cache_time = 300 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.108/identity {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.backend = dogpile.cache.null {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.backend_argument = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.backend_expiration_time = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.config_prefix = cache.oslo {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.debug_cache_backend = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.enable_retry_client = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.enable_socket_keepalive = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.enforce_fips_mode = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.expiration_time = 600 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.hashclient_retry_attempts = 2 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.memcache_dead_retry = 300 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.memcache_pool_maxsize = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.memcache_sasl_enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.password = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.proxies = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.redis_db = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82339) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.redis_sentinel_service_name = mymaster {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.redis_server = localhost:6379 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.retry_attempts = 2 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.retry_delay = 0.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82339]: WARNING cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.socket_keepalive_count = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82339]: WARNING cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.socket_keepalive_idle = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.socket_keepalive_interval = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.socket_timeout = 1.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.tls_allowed_ciphers = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.tls_cafile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Running cmd (subprocess): mount.quobyte {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.tls_certfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.tls_enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.tls_keyfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cache.username = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] coordination.backend_url = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.asyncio_connection = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.asyncio_slave_connection = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.backend = sqlalchemy {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.connection = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.connection_debug = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.connection_parameters = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.connection_recycle_time = 3600 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.connection_trace = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.db_inc_retry_interval = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.db_max_retries = 20 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.db_max_retry_interval = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.db_retry_interval = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.max_overflow = 50 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.max_pool_size = 5 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.max_retries = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.mysql_wsrep_sync_wait = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.pool_timeout = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.retry_interval = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.slave_connection = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.sqlite_synchronous = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.synchronous_reader = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] database.use_db_reconnect = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.connection_string = messaging:// {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.es_doc_type = notification {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.es_scroll_size = 10000 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.es_scroll_time = 2m {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.filter_error_trace = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.hmac_keys = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.sentinel_service_name = mymaster {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.socket_timeout = 0.1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.trace_requests = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler.trace_sqlalchemy = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler_jaeger.process_tags = {} {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler_jaeger.service_name_prefix = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] profiler_otlp.service_name_prefix = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.enforce_new_defaults = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: WARNING oslo_config.cfg [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.enforce_scope = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.policy_default_rule = default {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.policy_file = policy.yaml {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_policy.remote_timeout = 60.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] privsep_osbrick.group = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] privsep_osbrick.helper_command = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] privsep_osbrick.user = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_sys_admin.group = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_sys_admin.helper_command = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] cinder_sys_admin.user = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.auth_section = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.auth_type = password {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.cafile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.certfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.collect_timing = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.insecure = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.keyfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.send_service_user_token = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.split_loggers = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] service_user.timeout = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.auth_section = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.auth_type = password {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.certfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.collect_timing = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.insecure = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.keyfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.region_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.split_loggers = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] glance.timeout = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.backend_availability_zone = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.chap_password = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.chap_username = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.disk_geometry = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.driver_client_cert = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.driver_client_cert_key = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.driver_data_namespace = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.driver_use_ssl = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.enable_unsupported_driver = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.extra_capabilities = {} {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.filter_function = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.goodness_function = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.iscsi_target_flags = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.iscsi_write_cache = on {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.iser_helper = tgtadm {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.iser_ip_address = 192.168.122.108 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.iser_port = 3260 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_host = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_login = admin {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_mount_options = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_password = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_private_key = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_share_path = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_ssh_port = 22 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.num_shell_tries = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.nvmet_port_id = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.quobyte_client_cfg = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.quobyte_volume_url = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.replication_device = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.report_discard_supported = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.reserved_percentage = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.scst_target_driver = iscsi {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.scst_target_iqn_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.storage_protocol = iSCSI {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.target_helper = tgtadm {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.target_ip_address = 192.168.122.108 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.target_port = 3260 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.target_protocol = iscsi {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.trace_flags = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.unique_fqdn_network = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.use_chap_auth = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volume_backend_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volume_clear = zero {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volume_clear_ionice = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volume_clear_size = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_reports.file_event_handler = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_reports.log_dir = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.backend_availability_zone = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.backend_host = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.chap_password = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.chap_username = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.chiscsi_conf = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.disk_geometry = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.driver_client_cert = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.driver_client_cert_key = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.driver_data_namespace = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.driver_use_ssl = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.extra_capabilities = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.filter_function = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.goodness_function = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.iscsi_target_flags = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.iscsi_write_cache = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.iser_helper = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.iser_ip_address = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.iser_port = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.iser_target_prefix = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_host = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_login = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_mount_options = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_password = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_private_key = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_share_path = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_ssh_port = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.num_shell_tries = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nvmet_ns_id = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.nvmet_port_id = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.replication_device = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.report_discard_supported = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.reserved_percentage = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.scst_target_driver = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.storage_protocol = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.target_helper = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.target_ip_address = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.target_port = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.target_prefix = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.target_protocol = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.trace_flags = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.unique_fqdn_network = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.use_chap_auth = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volume_clear = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volume_clear_ionice = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volume_clear_size = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] QuobyteHD.volumes_dir = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.ssl = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.ssl_version = {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_notifications.driver = [] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_notifications.retry = -1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] oslo_messaging_notifications.transport_url = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] key_manager.fixed_key = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.barbican_api_version = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.barbican_endpoint = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.barbican_endpoint_type = public {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.barbican_region_name = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.cafile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.certfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.collect_timing = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.insecure = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.keyfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.number_of_retries = 60 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.retry_delay = 1 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.send_service_user_token = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.split_loggers = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.timeout = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.verify_ssl = True {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican.verify_ssl_path = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.auth_section = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.auth_type = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.cafile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.certfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.collect_timing = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.insecure = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.keyfile = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.split_loggers = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] barbican_service_user.timeout = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.approle_role_id = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.approle_secret_id = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.kv_mountpoint = secret {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.kv_path = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.kv_version = 2 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.namespace = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.root_token_id = **** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.ssl_ca_crt_file = None {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.timeout = 60.0 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.use_ssl = False {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:14 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] ******************************************************************************** {{(pid=82224) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 17:41:14 devstack quobyte-client[82343]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 17:41:14 devstack quobyte-client[82343]: Invalid parameters found, error: missing mount point. Apr 13 17:41:14 devstack quobyte-client[82343]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 17:41:14 devstack quobyte-client[82343]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 17:41:14 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] CMD "mount.quobyte" returned: 1 in 0.095s {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:14 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:41:14 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:41:14 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82339) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:41:14 devstack cinder-volume[82339]: INFO cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea ... Apr 13 17:41:14 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 -c /etc/quobyte/client-cinder.cfg {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:14 devstack sudo[82344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 -c /etc/quobyte/client-cinder.cfg Apr 13 17:41:14 devstack sudo[82344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:15 devstack sudo[82344]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.497s {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:15 devstack cinder-volume[82339]: INFO cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea succeeded Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82339) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.526s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:15 devstack sudo[82413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:41:15 devstack sudo[82413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:15 devstack sudo[82413]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.404s {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:15 devstack cinder-volume[82339]: INFO cinder.volume.driver [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Driver hasn't implemented _init_vendor_properties() Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG cinder.volume.driver [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82339) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_db.sqlalchemy.engines [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG dbcounter [-] [82339] Writer thread running {{(pid=82339) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG cinder.db.sqlalchemy.api [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Building query based on filter {{(pid=82339) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG cinder.image.image_utils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82339) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 17:41:15 devstack cinder-volume[82339]: INFO cinder.keymgr.migration [None req-f4caf69d-19f3-4ed4-acde-d3ddd1c9482c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82339) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82339) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:41:15 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:15 devstack sudo[82417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:41:15 devstack sudo[82417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:16 devstack sudo[82417]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.404s {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG cinder.manager [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Notifying Schedulers of capabilities ... {{(pid=82339) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:41:16 devstack cinder-volume[82339]: INFO cinder.volume.manager [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Driver initialization completed successfully. Apr 13 17:41:16 devstack cinder-volume[82339]: INFO cinder.manager [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Initiating service 3 cleanup Apr 13 17:41:16 devstack cinder-volume[82339]: INFO cinder.manager [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Service 3 cleanup completed. Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG cinder.service [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Creating RPC server for service cinder-volume {{(pid=82339) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG cinder.service [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82339) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 17:41:16 devstack cinder-volume[82339]: INFO cinder.volume.manager [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82339) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82339) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:16 devstack sudo[82423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:41:16 devstack sudo[82423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:16 devstack sudo[82423]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:16 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.431s {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:16 devstack cinder-volume[82339]: INFO cinder.volume.manager [None req-3591eaf6-e0d4-400a-8275-026723b97739 None None] Driver post RPC initialization completed successfully. Apr 13 17:41:19 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-45af7e75-3c48-4e2f-a1de-0f3b43a557ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:41:19 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-45af7e75-3c48-4e2f-a1de-0f3b43a557ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:41:19 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-45af7e75-3c48-4e2f-a1de-0f3b43a557ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82339) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:41:19 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-45af7e75-3c48-4e2f-a1de-0f3b43a557ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82339) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:41:19 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-45af7e75-3c48-4e2f-a1de-0f3b43a557ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:41:19 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-45af7e75-3c48-4e2f-a1de-0f3b43a557ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:19 devstack sudo[82489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:41:19 devstack sudo[82489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:19 devstack sudo[82489]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:19 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-45af7e75-3c48-4e2f-a1de-0f3b43a557ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.370s {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:20 devstack cinder-volume[82339]: DEBUG cinder.manager [None req-45af7e75-3c48-4e2f-a1de-0f3b43a557ee None None] Notifying Schedulers of capabilities ... {{(pid=82339) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:41:23 devstack cinder-volume[82224]: INFO oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Caught SIGTERM, stopping children Apr 13 17:41:23 devstack cinder-volume[82224]: DEBUG oslo_concurrency.lockutils [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Acquiring lock "singleton_lock" {{(pid=82224) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:41:23 devstack cinder-volume[82224]: DEBUG oslo_concurrency.lockutils [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Acquired lock "singleton_lock" {{(pid=82224) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:41:23 devstack cinder-volume[82224]: DEBUG oslo_concurrency.lockutils [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Releasing lock "singleton_lock" {{(pid=82224) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:41:23 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Stop services. {{(pid=82224) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 17:41:23 devstack cinder-volume[82224]: DEBUG oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Killing children. {{(pid=82224) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 17:41:23 devstack cinder-volume[82224]: INFO oslo_service.backend._eventlet.service [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Waiting on 1 children to exit Apr 13 17:41:26 devstack cinder-volume[82339]: DEBUG dbcounter [-] [82339] Writing DB stats cinder:SELECT=3 {{(pid=82339) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:41:26 devstack cinder-volume[82339]: DEBUG dbcounter [-] [82339] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82339) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:41:27 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-5e2c31eb-2fd1-4cba-8c3c-dadef23d5f20 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:41:27 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-5e2c31eb-2fd1-4cba-8c3c-dadef23d5f20 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:41:27 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-5e2c31eb-2fd1-4cba-8c3c-dadef23d5f20 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82339) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:41:27 devstack cinder-volume[82339]: DEBUG cinder.volume.drivers.quobyte [None req-5e2c31eb-2fd1-4cba-8c3c-dadef23d5f20 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82339) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:41:27 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-5e2c31eb-2fd1-4cba-8c3c-dadef23d5f20 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82339) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:41:27 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-5e2c31eb-2fd1-4cba-8c3c-dadef23d5f20 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:27 devstack sudo[82586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:41:27 devstack sudo[82586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:27 devstack sudo[82586]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:27 devstack cinder-volume[82339]: DEBUG oslo_concurrency.processutils [None req-5e2c31eb-2fd1-4cba-8c3c-dadef23d5f20 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.419s {{(pid=82339) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:27 devstack cinder-volume[82339]: DEBUG cinder.manager [None req-5e2c31eb-2fd1-4cba-8c3c-dadef23d5f20 None None] Notifying Schedulers of capabilities ... {{(pid=82339) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:41:28 devstack cinder-volume[82339]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 13 17:41:28 devstack cinder-volume[82598]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 17:41:28 devstack cinder-volume[82598]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:41:28 devstack cinder-volume[82598]: we strongly recommend against using it for new projects. Apr 13 17:41:28 devstack cinder-volume[82598]: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:41:28 devstack cinder-volume[82598]: framework. For more detail see Apr 13 17:41:28 devstack cinder-volume[82598]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:41:28 devstack cinder-volume[82598]: import eventlet # noqa Apr 13 17:41:29 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Acquiring lock "singleton_lock" {{(pid=82339) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:41:29 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Acquired lock "singleton_lock" {{(pid=82339) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:41:29 devstack cinder-volume[82339]: DEBUG oslo_concurrency.lockutils [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Releasing lock "singleton_lock" {{(pid=82339) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:41:29 devstack cinder-volume[82339]: WARNING amqp [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 17:41:29 devstack cinder-volume[82339]: WARNING amqp [None req-75629b5e-eb33-43ad-8bac-8648b2c490ef None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 17:41:30 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 17:41:30 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 17:41:30 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 17:41:30 devstack cinder-volume[82598]: INFO dbcounter [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Registered counter for database cinder Apr 13 17:41:30 devstack cinder-volume[82598]: DEBUG oslo_db.sqlalchemy.engines [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG dbcounter [-] [82598] Writer thread running {{(pid=82598) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:41:31 devstack cinder-volume[82598]: INFO cinder.rpc [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 17:41:31 devstack cinder-volume[82598]: INFO cinder.rpc [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_db.sqlalchemy.engines [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:41:31 devstack cinder-volume[82598]: INFO cinder.volume.manager [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Determined volume DB was empty at startup. Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG cinder.volume.manager [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82598) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 17:41:31 devstack cinder-volume[82598]: WARNING stevedore.named [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 17:41:31 devstack cinder-volume[82598]: WARNING castellan.key_manager [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:41:31 devstack cinder-volume[82598]: WARNING cinder.keymgr.conf_key_mgr [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 17:41:31 devstack cinder-volume[82598]: INFO cinder.volume.manager [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_db.sqlalchemy.engines [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:41:31 devstack cinder-volume[82598]: INFO oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Starting 1 workers Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Started child 82736 {{(pid=82598) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Full set of CONF: {{(pid=82598) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] ******************************************************************************** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Configuration options gathered from: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] ================================================================================ {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 17:41:31 devstack cinder-volume[82736]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] allow_availability_zone_fallback = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] allow_compression_on_image_upload = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] allowed_direct_url_schemes = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] api_rate_limit = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] auth_strategy = keystone {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_availability_zone = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_host = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_stats_polling_interval = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backup_api_class = cinder.backup.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backup_name_template = backup-%s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backup_use_same_host = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backup_use_temp_snapshot = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] chap_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] chap_username = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_internal_tenant_project_id = 585d10f4e738498cbe1d19693839f4e2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_internal_tenant_user_id = 61fa68109e2c46878bcf71573a30ddc5 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cluster = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] compression_format = gzip {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] compute_api_class = cinder.compute.nova.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] config_dir = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] config_source = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] control_exchange = openstack {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] debug = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] default_availability_zone = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] default_group_type = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] default_volume_type = QuobyteHD {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] disk_geometry = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] driver_client_cert = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] driver_client_cert_key = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] driver_data_namespace = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] driver_ssl_cert_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] driver_ssl_cert_verify = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] driver_use_ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] enable_new_services = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] enable_unsupported_driver = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] enabled_backends = ['QuobyteHD'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] enforce_multipath_for_image_xfer = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] filter_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_api_insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_api_servers = ['http://192.168.122.108/image'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_api_ssl_compression = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_ca_certificates_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_catalog_info = image:glance:publicURL {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_num_retries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance_request_timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] goodness_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] graceful_shutdown_timeout = 5 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] group_api_class = cinder.group.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] host = devstack {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_compress_on_upload = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_conversion_address_space_limit = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_conversion_cpu_limit = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_conversion_disable = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_upload_use_cinder_backend = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_upload_use_internal_tenant = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_volume_cache_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_volume_cache_max_count = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] image_volume_cache_max_size_gb = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82736) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] init_host_max_objects_retrieval = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] instance_format = [instance: %(uuid)s] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] iscsi_target_flags = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] iscsi_write_cache = on {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] iser_helper = tgtadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] iser_ip_address = 192.168.122.108 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] iser_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_color = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_config_append = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_dir = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_options = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_rotate_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_rotate_interval_type = days {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] log_rotation_type = none {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] max_age = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] max_logfile_count = 30 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] max_logfile_size_mb = 200 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] max_over_subscription_ratio = 20.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] message_reap_interval = 86400 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] message_ttl = 2592000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] migration_create_volume_timeout_secs = 300 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] monkey_patch = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] monkey_patch_modules = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] my_ip = 192.168.122.108 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] no_snapshot_gb_quota = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] num_iser_scan_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] num_shell_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] num_volume_device_scan_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] nvmeof_conn_info_version = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] nvmet_ns_id = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] nvmet_port_id = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] osapi_max_limit = 1000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] osapi_volume_ext_list = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] osapi_volume_listen = 0.0.0.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] osapi_volume_listen_port = 8776 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] osapi_volume_use_ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] osapi_volume_workers = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] per_volume_size_limit = -1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] periodic_fuzzy_delay = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] periodic_interval = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] project_id_regex = [0-9a-f\-]+ {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] public_endpoint = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] publish_errors = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] quota_backup_gigabytes = 1000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] quota_backups = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] quota_gigabytes = 1000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] quota_groups = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] quota_snapshots = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] quota_volumes = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] rate_limit_burst = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] rate_limit_except_level = CRITICAL {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] rate_limit_interval = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] reinit_driver_count = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] replication_device = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] report_discard_supported = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] report_interval = 120 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] reservation_clean_interval = 86400 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] reservation_expire = 86400 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] reserved_image_namespaces = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] reserved_percentage = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] rpc_response_timeout = 120 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] run_external_periodic_tasks = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] scst_target_driver = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] scst_target_iqn_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_down_time = 720 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] shell_completion = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] snapshot_name_template = snapshot-%s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] state_path = /opt/stack/data/cinder {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] storage_availability_zone = nova {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] storage_protocol = iSCSI {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] syslog_log_facility = LOG_USER {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] target_helper = lioadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] target_ip_address = 192.168.122.108 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] target_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] target_protocol = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] target_secondary_ip_addresses = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] trace_flags = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] transfer_api_class = cinder.transfer.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] transport_url = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] until_refresh = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] use_chap_auth = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] use_default_quota_class = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] use_journal = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] use_json = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] use_multipath_for_image_xfer = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] use_stderr = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] use_syslog = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] verify_glance_signatures = enabled {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_api_class = cinder.volume.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_backend_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_clear = zero {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_clear_ionice = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_clear_size = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_copy_bps_limit = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_dd_blocksize = 1M {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_name_template = volume-%s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_service_inithost_offload = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volume_usage_audit_period = month {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] zoning_mode = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_concurrency.disable_process_locking = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.admin_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.admin_token = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.admin_user = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.auth_admin_prefix = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.auth_port = 35357 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.auth_protocol = https {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.auth_section = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.auth_type = password {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.auth_uri = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.auth_version = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.cache = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82736) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.identity_uri = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.include_service_catalog = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 17:41:31 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.interface = public {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_password = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Running cmd (subprocess): mount.quobyte {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcache_username = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.region_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.service_token_roles_required = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.service_type = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.108/identity {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.backend = dogpile.cache.null {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.backend_argument = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.backend_expiration_time = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.config_prefix = cache.oslo {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.debug_cache_backend = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.enable_retry_client = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.enable_socket_keepalive = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.enforce_fips_mode = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.expiration_time = 600 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.hashclient_retry_attempts = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.memcache_dead_retry = 300 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.memcache_pool_maxsize = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.memcache_sasl_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.proxies = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.redis_db = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.redis_server = localhost:6379 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.retry_attempts = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.retry_delay = 0.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.socket_keepalive_count = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.socket_keepalive_idle = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.socket_keepalive_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.socket_timeout = 1.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.tls_allowed_ciphers = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.tls_cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.tls_certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.tls_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.tls_keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cache.username = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] coordination.backend_url = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.asyncio_connection = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.asyncio_slave_connection = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.backend = sqlalchemy {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.connection = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.connection_debug = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.connection_parameters = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.connection_recycle_time = 3600 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.connection_trace = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.db_inc_retry_interval = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.db_max_retries = 20 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.db_max_retry_interval = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.db_retry_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.max_overflow = 50 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.max_pool_size = 5 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.max_retries = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.mysql_wsrep_sync_wait = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.pool_timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.retry_interval = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.slave_connection = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.sqlite_synchronous = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.synchronous_reader = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] database.use_db_reconnect = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.connection_string = messaging:// {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.es_doc_type = notification {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.es_scroll_size = 10000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.es_scroll_time = 2m {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.filter_error_trace = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.hmac_keys = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.sentinel_service_name = mymaster {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.socket_timeout = 0.1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.trace_requests = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler.trace_sqlalchemy = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler_jaeger.process_tags = {} {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler_jaeger.service_name_prefix = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] profiler_otlp.service_name_prefix = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.enforce_new_defaults = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: WARNING oslo_config.cfg [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.enforce_scope = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.policy_default_rule = default {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.policy_file = policy.yaml {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_policy.remote_timeout = 60.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack quobyte-client[82764]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 17:41:31 devstack quobyte-client[82764]: Invalid parameters found, error: missing mount point. Apr 13 17:41:31 devstack quobyte-client[82764]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 17:41:31 devstack quobyte-client[82764]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] privsep_osbrick.group = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] privsep_osbrick.helper_command = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] privsep_osbrick.user = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_sys_admin.group = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_sys_admin.helper_command = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] cinder_sys_admin.user = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.auth_section = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.auth_type = password {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.collect_timing = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.send_service_user_token = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] service_user.timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.auth_section = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.auth_type = password {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.collect_timing = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.region_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] glance.timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.backend_availability_zone = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.chap_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.chap_username = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.disk_geometry = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.driver_client_cert = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.driver_client_cert_key = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.driver_data_namespace = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.driver_use_ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.extra_capabilities = {} {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.filter_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.goodness_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.iscsi_target_flags = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.iscsi_write_cache = on {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.iser_helper = tgtadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.iser_ip_address = 192.168.122.108 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.iser_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_host = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_login = admin {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_mount_options = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_private_key = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_share_path = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_ssh_port = 22 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.num_shell_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack sudo[82767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack sudo[82767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.quobyte_client_cfg = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.quobyte_volume_url = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.replication_device = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.report_discard_supported = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.reserved_percentage = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.target_helper = tgtadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.target_ip_address = 192.168.122.108 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.target_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.target_protocol = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.trace_flags = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.unique_fqdn_network = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.use_chap_auth = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volume_backend_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volume_clear = zero {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volume_clear_ionice = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volume_clear_size = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_reports.file_event_handler = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_reports.log_dir = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.backend_availability_zone = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.backend_host = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.chap_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.chap_username = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.chiscsi_conf = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.disk_geometry = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.driver_client_cert = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.driver_client_cert_key = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.driver_data_namespace = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.driver_use_ssl = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.extra_capabilities = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.filter_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.goodness_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.iscsi_target_flags = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.iscsi_write_cache = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.iser_helper = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.iser_ip_address = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.iser_port = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.iser_target_prefix = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_host = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_login = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_mount_options = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_private_key = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_share_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_ssh_port = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.num_shell_tries = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nvmet_ns_id = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.nvmet_port_id = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.replication_device = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.report_discard_supported = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.reserved_percentage = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.scst_target_driver = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.storage_protocol = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.target_helper = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.target_ip_address = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.target_port = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.target_prefix = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.target_protocol = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.trace_flags = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.unique_fqdn_network = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.use_chap_auth = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volume_clear = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volume_clear_ionice = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volume_clear_size = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] QuobyteHD.volumes_dir = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.ssl_version = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_notifications.driver = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_notifications.retry = -1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] key_manager.fixed_key = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.barbican_api_version = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.barbican_endpoint = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.barbican_endpoint_type = public {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.barbican_region_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.collect_timing = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.number_of_retries = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.retry_delay = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.send_service_user_token = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.verify_ssl = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican.verify_ssl_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.auth_section = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.auth_type = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.collect_timing = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] barbican_service_user.timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.approle_role_id = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.approle_secret_id = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.kv_mountpoint = secret {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.kv_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.kv_version = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.namespace = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.root_token_id = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.ssl_ca_crt_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.timeout = 60.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.use_ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 17:41:31 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-d43bcb4b-fe22-4103-a96c-ef761435089a None None] ******************************************************************************** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 17:41:31 devstack sudo[82767]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.433s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:31 devstack cinder-volume[82736]: INFO cinder.volume.driver [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Driver hasn't implemented _init_vendor_properties() Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.volume.driver [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82736) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_db.sqlalchemy.engines [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writer thread running {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.db.sqlalchemy.api [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Building query based on filter {{(pid=82736) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82736) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:41:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:31 devstack cinder-volume[82736]: INFO cinder.keymgr.migration [None req-486ee0ab-88d4-4161-9289-49c16ddb843a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 17:41:31 devstack sudo[82805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:41:31 devstack sudo[82805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:32 devstack sudo[82805]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.385s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:41:32 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Driver initialization completed successfully. Apr 13 17:41:32 devstack cinder-volume[82736]: INFO cinder.manager [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Initiating service 3 cleanup Apr 13 17:41:32 devstack cinder-volume[82736]: INFO cinder.manager [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Service 3 cleanup completed. Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG cinder.service [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Creating RPC server for service cinder-volume {{(pid=82736) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG cinder.service [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82736) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 17:41:32 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:41:32 devstack sudo[82823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:41:32 devstack sudo[82823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:41:32 devstack sudo[82823]: pam_unix(sudo:session): session closed for user root Apr 13 17:41:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.419s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:41:32 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-00852d20-3163-49d7-b320-fda5c412f9b2 None None] Driver post RPC initialization completed successfully. Apr 13 17:41:41 devstack cinder-volume[82598]: DEBUG dbcounter [-] [82598] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82598) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:41:42 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:41:42 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=3 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:42:34 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:42:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Flow 'volume_create_manager' (1250bbb9-72aa-443e-8eb7-01568b4802f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:42:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cae472-3b53-4da5-80d8-780dbf811d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cae472-3b53-4da5-80d8-780dbf811d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-111422211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775a16fb-a1ee-4531-afc7-f8c21402aed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d48d21c3e0fc4ef18611e4ac4b99ad97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:42:35Z,use_quota=True,user_id='88183fa6844647ab9b2eb55a7ce9493d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf88b251-4c87-45eb-a4ff-27ebbb173863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf88b251-4c87-45eb-a4ff-27ebbb173863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ef5aac-a392-4647-8390-64c074daf344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ef5aac-a392-4647-8390-64c074daf344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '775a16fb-a1ee-4531-afc7-f8c21402aed0', 'volume_name': 'volume-775a16fb-a1ee-4531-afc7-f8c21402aed0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cb7f91-2118-4aad-b98d-b3ed4423e2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cb7f91-2118-4aad-b98d-b3ed4423e2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cd9f82-9c4c-401f-b9f8-1b1d3dff4e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:35 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Volume 775a16fb-a1ee-4531-afc7-f8c21402aed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-775a16fb-a1ee-4531-afc7-f8c21402aed0', 'volume_size': 1} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-111422211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775a16fb-a1ee-4531-afc7-f8c21402aed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d48d21c3e0fc4ef18611e4ac4b99ad97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:42:35Z,use_quota=True,user_id='88183fa6844647ab9b2eb55a7ce9493d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Creating volume 775a16fb-a1ee-4531-afc7-f8c21402aed0 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:42:35 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:42:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:42:35 devstack sudo[83584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 1073741824 Apr 13 17:42:35 devstack sudo[83584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:42:36 devstack sudo[83584]: pam_unix(sudo:session): session closed for user root Apr 13 17:42:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 1073741824" returned: 0 in 1.760s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:42:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:42:37 devstack sudo[83927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 Apr 13 17:42:37 devstack sudo[83927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:42:38 devstack sudo[83927]: pam_unix(sudo:session): session closed for user root Apr 13 17:42:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0" returned: 0 in 1.002s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:42:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] <== create_volume: return (2852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:42:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.855s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:42:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cd9f82-9c4c-401f-b9f8-1b1d3dff4e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775a16fb-a1ee-4531-afc7-f8c21402aed0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374ae5c2-9f81-4132-b08a-ae618fd86cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:38 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Volume volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 (775a16fb-a1ee-4531-afc7-f8c21402aed0): created successfully Apr 13 17:42:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374ae5c2-9f81-4132-b08a-ae618fd86cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Flow 'volume_create_manager' (1250bbb9-72aa-443e-8eb7-01568b4802f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:42:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-925a1756-e712-4823-92c1-0763d8b2080f tempest-ServerRescueNegativeTestJSON-1357702900 None] Created volume successfully. Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Flow 'volume_create_manager' (f9ef4048-8798-4d10-9f55-60feb88bf89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ce3a88-1469-47ae-bc63-31fa60f32f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ce3a88-1469-47ae-bc63-31fa60f32f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:42:46Z,deleted=False,deleted_at=None,display_description='',display_name='d2fbacf9-2596-488f-aa9e-250ccb2fc026-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993df86383d340429ff38a0aa77f336d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:42:47Z,use_quota=True,user_id='d61c0c401dc3460db3f1d4d47d73759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8535d3-359b-45e9-856d-7b003bba3b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8535d3-359b-45e9-856d-7b003bba3b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec262fd-615f-4ccc-b884-884e870911e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec262fd-615f-4ccc-b884-884e870911e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f', 'volume_name': 'volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d876f2ef-e417-448b-856b-ffb9fe7e5cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d876f2ef-e417-448b-856b-ffb9fe7e5cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd21829-c5ee-49c6-b9d8-3ed474a8bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:46 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Volume 224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f', 'volume_size': 1} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:42:46Z,deleted=False,deleted_at=None,display_description='',display_name='d2fbacf9-2596-488f-aa9e-250ccb2fc026-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993df86383d340429ff38a0aa77f336d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:42:47Z,use_quota=True,user_id='d61c0c401dc3460db3f1d4d47d73759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Creating volume 224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:42:46 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:42:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:42:46 devstack sudo[84016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f 1073741824 Apr 13 17:42:46 devstack sudo[84016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:42:48 devstack sudo[84016]: pam_unix(sudo:session): session closed for user root Apr 13 17:42:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f 1073741824" returned: 0 in 1.289s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:42:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:42:48 devstack sudo[84025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f Apr 13 17:42:48 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:42:49 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root Apr 13 17:42:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f" returned: 0 in 1.494s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:42:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] <== create_volume: return (2883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:42:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.885s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:42:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd21829-c5ee-49c6-b9d8-3ed474a8bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (defdd9c6-4137-4d58-a40e-6332d53d911b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:49 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Volume volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f (224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f): created successfully Apr 13 17:42:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (defdd9c6-4137-4d58-a40e-6332d53d911b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Flow 'volume_create_manager' (f9ef4048-8798-4d10-9f55-60feb88bf89c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:42:49 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-3c0300a4-5f90-4770-892d-57cbbea76efb tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Created volume successfully. Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Flow 'volume_create_manager' (b646cc83-a4b4-40c8-b12f-14494f25aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10728145-4201-42e7-b5e1-9b553994e510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10728145-4201-42e7-b5e1-9b553994e510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1031558598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27697fd6-3912-4a72-b18f-5dac63da49e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='365a2c6530054143890cd34c5777453c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:42:54Z,use_quota=True,user_id='a6f92babf91345a08832f8fbdad41f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b226e48c-4708-42c0-9bbf-a2ceaf92832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b226e48c-4708-42c0-9bbf-a2ceaf92832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8a649f-1b3f-49a1-bb4c-82b022ea9de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8a649f-1b3f-49a1-bb4c-82b022ea9de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27697fd6-3912-4a72-b18f-5dac63da49e3', 'volume_name': 'volume-27697fd6-3912-4a72-b18f-5dac63da49e3', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bbdae6-092c-42c3-a295-9987f609fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bbdae6-092c-42c3-a295-9987f609fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34bfb59-7450-44ab-afab-99f10d5ac4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:54 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Volume 27697fd6-3912-4a72-b18f-5dac63da49e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27697fd6-3912-4a72-b18f-5dac63da49e3', 'volume_size': 1} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1031558598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27697fd6-3912-4a72-b18f-5dac63da49e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='365a2c6530054143890cd34c5777453c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:42:54Z,use_quota=True,user_id='a6f92babf91345a08832f8fbdad41f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Creating volume 27697fd6-3912-4a72-b18f-5dac63da49e3 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:42:54 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:42:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:42:54 devstack sudo[84070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 1073741824 Apr 13 17:42:54 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:42:55 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root Apr 13 17:42:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 1073741824" returned: 0 in 1.633s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:42:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:42:55 devstack sudo[84087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 Apr 13 17:42:55 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:42:57 devstack cinder-volume[82736]: WARNING py.warnings [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 13 17:42:57 devstack cinder-volume[82736]: .first() Apr 13 17:42:57 devstack cinder-volume[82736]: Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:42:57 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3" returned: 0 in 1.589s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] <== create_volume: return (3283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.285s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.068s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:42:57 devstack cinder-volume[82736]: INFO oslo.privsep.daemon [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxzws6445/privsep.sock'] Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34bfb59-7450-44ab-afab-99f10d5ac4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27697fd6-3912-4a72-b18f-5dac63da49e3', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed7e86a-7664-4d50-a58c-b3da21e7ee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:42:57 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxzws6445/privsep.sock Apr 13 17:42:57 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:42:57 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Volume volume-27697fd6-3912-4a72-b18f-5dac63da49e3 (27697fd6-3912-4a72-b18f-5dac63da49e3): created successfully Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed7e86a-7664-4d50-a58c-b3da21e7ee0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:42:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Flow 'volume_create_manager' (b646cc83-a4b4-40c8-b12f-14494f25aee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:42:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-533133a9-3f37-4716-adb2-8164678fc74b tempest-ServersNegativeTestJSON-947222592 None] Created volume successfully. Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 17:42:58 devstack cinder-volume[82736]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 13 17:43:00 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:00 devstack cinder-volume[82736]: INFO oslo.privsep.daemon [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Spawned new privsep daemon via rootwrap Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Accepted privsep connection to /tmp/tmpxzws6445/privsep.sock {{(pid=82736) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 13 17:43:00 devstack cinder-volume[82736]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 13 17:43:00 devstack cinder-volume[82736]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 13 17:43:00 devstack cinder-volume[82736]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 13 17:43:00 devstack cinder-volume[82736]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84160 Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cde122b-15ad-42c7-8b8e-caf194bb611e]: (2,) {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[184148ca-8bed-496c-aa80-db42262a631f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:00 devstack sudo[84177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f Apr 13 17:43:00 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Acquiring lock "cinder-775a16fb-a1ee-4531-afc7-f8c21402aed0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "cinder-775a16fb-a1ee-4531-afc7-f8c21402aed0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Acquiring lock "cinder-quobyte-775a16fb-a1ee-4531-afc7-f8c21402aed0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "cinder-quobyte-775a16fb-a1ee-4531-afc7-f8c21402aed0" acquired by "delete_volume" :: waited 0.017s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cf6073-b7ab-4429-9f2f-1a434d346bf5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:01 devstack sudo[84179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 Apr 13 17:43:01 devstack sudo[84179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:01 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f" returned: 0 in 1.422s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.030s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Flow 'volume_create_manager' (73b4557f-ede4-428e-b641-179f7e088a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1aac3a6-5b6f-41de-906b-c5837f77ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea', 'name': 'volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41f976e7-8424-4e02-ae37-6ebec15c2b94', 'enforce_multipath': True} {{(pid=82736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1aac3a6-5b6f-41de-906b-c5837f77ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-49596139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6182143d-0153-47c5-8930-12a0ebf4e0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='365a2c6530054143890cd34c5777453c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:02Z,use_quota=True,user_id='a6f92babf91345a08832f8fbdad41f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becef7e6-fd05-449d-968c-bed9d267648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becef7e6-fd05-449d-968c-bed9d267648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d38c6a-80ee-4a4d-aff7-ee78a798e875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d38c6a-80ee-4a4d-aff7-ee78a798e875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6182143d-0153-47c5-8930-12a0ebf4e0f5', 'volume_name': 'volume-6182143d-0153-47c5-8930-12a0ebf4e0f5', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896d9567-36f7-4d9e-bbf7-6b6cefb91e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896d9567-36f7-4d9e-bbf7-6b6cefb91e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2369c663-f01f-4b5b-92e3-74af52940cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:01 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Volume 6182143d-0153-47c5-8930-12a0ebf4e0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6182143d-0153-47c5-8930-12a0ebf4e0f5', 'volume_size': 1} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-49596139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6182143d-0153-47c5-8930-12a0ebf4e0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='365a2c6530054143890cd34c5777453c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:02Z,use_quota=True,user_id='a6f92babf91345a08832f8fbdad41f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Creating volume 6182143d-0153-47c5-8930-12a0ebf4e0f5 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:43:01 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:43:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:01 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 1073741824 Apr 13 17:43:01 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:02 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-b5286eae-2ee8-4983-9121-0fd1ea824565 req-95579525-2b89-4641-aa69-3330cbafb675 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] attachment_update completed successfully. Apr 13 17:43:02 devstack sudo[84179]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0" returned: 0 in 1.527s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:02 devstack sudo[84193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0 Apr 13 17:43:02 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:03 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-775a16fb-a1ee-4531-afc7-f8c21402aed0" returned: 0 in 0.800s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "cinder-quobyte-775a16fb-a1ee-4531-afc7-f8c21402aed0" released by "delete_volume" :: held 2.500s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:03 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:03 devstack cinder-volume[82736]: WARNING cinder.quota [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:43:03 devstack cinder-volume[82736]: WARNING cinder.quota [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 1073741824" returned: 0 in 1.402s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Created reservations ['5c618ae2-3471-4196-aff4-81eddd75124d', '45bd4e37-9bae-4a21-aede-bfe0b8183fdd', '3f5e0bf2-f962-4883-a6bd-93e27027bbe9', 'a75b82d3-f7c4-469c-a4fb-c6f7423d8196'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:03 devstack sudo[84199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 Apr 13 17:43:03 devstack sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:03 devstack sudo[84210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:03 devstack sudo[84210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:04 devstack sudo[84210]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.978s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:04 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Deleted volume successfully. Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-de82bbde-5094-471d-9275-f06c999f19b1 tempest-ServerRescueNegativeTestJSON-1357702900 None] Lock "cinder-775a16fb-a1ee-4531-afc7-f8c21402aed0-delete_volume" released by "delete_volume" :: held 3.986s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:04 devstack sudo[84199]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5" returned: 0 in 1.319s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] <== create_volume: return (2792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.795s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2369c663-f01f-4b5b-92e3-74af52940cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6182143d-0153-47c5-8930-12a0ebf4e0f5', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18106a9-34ea-45a1-b4c1-c2fca958169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:04 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Volume volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 (6182143d-0153-47c5-8930-12a0ebf4e0f5): created successfully Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18106a9-34ea-45a1-b4c1-c2fca958169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Flow 'volume_create_manager' (73b4557f-ede4-428e-b641-179f7e088a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:04 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d0090fcc-62bb-4622-a75f-d1c1ea37e777 tempest-ServersNegativeTestJSON-947222592 None] Created volume successfully. Apr 13 17:43:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "cinder-6182143d-0153-47c5-8930-12a0ebf4e0f5-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Lock "cinder-6182143d-0153-47c5-8930-12a0ebf4e0f5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "cinder-quobyte-6182143d-0153-47c5-8930-12a0ebf4e0f5" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Lock "cinder-quobyte-6182143d-0153-47c5-8930-12a0ebf4e0f5" acquired by "delete_volume" :: waited 0.024s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:07 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d711a-ff51-4e28-bc76-f93bf1fbe391]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:07 devstack sudo[84319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 Apr 13 17:43:07 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:08 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5" returned: 0 in 1.286s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:08 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5 Apr 13 17:43:08 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:09 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6182143d-0153-47c5-8930-12a0ebf4e0f5" returned: 0 in 1.415s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:09 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:09 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Lock "cinder-quobyte-6182143d-0153-47c5-8930-12a0ebf4e0f5" released by "delete_volume" :: held 2.790s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Created reservations ['1ed0071a-512c-4a5c-97ed-d138747accae', '9e45efb8-487e-4fce-b97d-ed802e5e9cab', '0bda9e7f-5bdd-4299-8f61-c187c83c51bf', '98dbef7b-51be-4c1f-b50a-9467abccae75'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:10 devstack sudo[84671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:10 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "cinder-27697fd6-3912-4a72-b18f-5dac63da49e3-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Lock "cinder-27697fd6-3912-4a72-b18f-5dac63da49e3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "cinder-quobyte-27697fd6-3912-4a72-b18f-5dac63da49e3" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Lock "cinder-quobyte-27697fd6-3912-4a72-b18f-5dac63da49e3" acquired by "delete_volume" :: waited 0.018s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1f9e32-672e-42e1-9fdc-6a5a74d64ab8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:11 devstack sudo[84673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 Apr 13 17:43:11 devstack sudo[84673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:11 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 1.596s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:11 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:11 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 1.754s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:11 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:11 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Deleted volume successfully. Apr 13 17:43:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7231b604-ab5f-4e1e-bde7-db89adcf2498 tempest-ServersNegativeTestJSON-947222592 None] Lock "cinder-6182143d-0153-47c5-8930-12a0ebf4e0f5-delete_volume" released by "delete_volume" :: held 4.984s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:12 devstack sudo[84673]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3" returned: 0 in 1.587s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:12 devstack sudo[84680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3 Apr 13 17:43:12 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:13 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-27697fd6-3912-4a72-b18f-5dac63da49e3" returned: 0 in 1.159s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Lock "cinder-quobyte-27697fd6-3912-4a72-b18f-5dac63da49e3" released by "delete_volume" :: held 2.848s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:14 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Created reservations ['cc52c669-83bc-4422-867f-1f052e126653', '98f92810-b2ae-40b4-b7f4-b276dca79f3d', '72abc248-694b-40ef-b32f-e6d95d142184', 'af7b9209-9611-4d43-8185-be3585022723'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:21 devstack sudo[84715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:21 devstack sudo[84715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:22 devstack sudo[84715]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 1.086s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:22 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:22 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Deleted volume successfully. Apr 13 17:43:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a939a2b2-447b-4a9c-8128-799b79e9eaf2 tempest-ServersNegativeTestJSON-947222592 None] Lock "cinder-27697fd6-3912-4a72-b18f-5dac63da49e3-delete_volume" released by "delete_volume" :: held 11.533s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:26 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:UPDATE=35,cinder:SELECT=29,cinder:DELETE=3,cinder:INSERT=6 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=28,cinder:UPDATE=40,cinder:INSERT=10,cinder:DELETE=4 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Flow 'volume_create_manager' (0029991c-1e0d-4465-82b0-76ec20fa8052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fcf6f4b-89dc-42c7-83c1-3fe734813263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fcf6f4b-89dc-42c7-83c1-3fe734813263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-461949196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b3cc5b-a12f-453a-8646-25ed0556937e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d4609b95cb945c49992437705394945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:33Z,use_quota=True,user_id='2e717e0553194dd7b55a73492a341f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90c32de-4e5e-4b4c-b25d-6a3ef1034745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90c32de-4e5e-4b4c-b25d-6a3ef1034745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d7312a-de81-4b12-8094-655d8bd79ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d7312a-de81-4b12-8094-655d8bd79ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b3cc5b-a12f-453a-8646-25ed0556937e', 'volume_name': 'volume-79b3cc5b-a12f-453a-8646-25ed0556937e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db097357-9c11-4f2c-9448-f323ec4358fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db097357-9c11-4f2c-9448-f323ec4358fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff507edd-0475-49c8-a781-107b73c45e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:32 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Volume 79b3cc5b-a12f-453a-8646-25ed0556937e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b3cc5b-a12f-453a-8646-25ed0556937e', 'volume_size': 1} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-461949196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b3cc5b-a12f-453a-8646-25ed0556937e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d4609b95cb945c49992437705394945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:33Z,use_quota=True,user_id='2e717e0553194dd7b55a73492a341f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Creating volume 79b3cc5b-a12f-453a-8646-25ed0556937e {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:43:32 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:43:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:32 devstack sudo[84873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e 1073741824 Apr 13 17:43:33 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:34 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e 1073741824" returned: 0 in 1.081s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:34 devstack sudo[84880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e Apr 13 17:43:34 devstack sudo[84880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Flow 'volume_create_manager' (703fd43c-f242-406d-ab85-818f86fdbcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b576e0-55fd-4e79-a852-81a318c43fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b576e0-55fd-4e79-a852-81a318c43fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1457880912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c078a3-acba-4580-8e17-cb4758fc21e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4b73cfefa0b4362bd302ad23b38855a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:34Z,use_quota=True,user_id='d671d609270f434f84e45bd2907c2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4ed2c2-3ea5-4654-afc3-587638ca5da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4ed2c2-3ea5-4654-afc3-587638ca5da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b480dde-6e8d-4dd0-810e-182640366393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b480dde-6e8d-4dd0-810e-182640366393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c078a3-acba-4580-8e17-cb4758fc21e7', 'volume_name': 'volume-68c078a3-acba-4580-8e17-cb4758fc21e7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd35e676-91ab-4e2f-801e-a8b6e1230e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd35e676-91ab-4e2f-801e-a8b6e1230e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f842137a-96ab-49cb-8a00-723a431b84be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:34 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Volume 68c078a3-acba-4580-8e17-cb4758fc21e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c078a3-acba-4580-8e17-cb4758fc21e7', 'volume_size': 1} Apr 13 17:43:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:35 devstack sudo[84880]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e" returned: 0 in 0.945s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1457880912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c078a3-acba-4580-8e17-cb4758fc21e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4b73cfefa0b4362bd302ad23b38855a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:34Z,use_quota=True,user_id='d671d609270f434f84e45bd2907c2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Creating volume 68c078a3-acba-4580-8e17-cb4758fc21e7 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:43:35 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff507edd-0475-49c8-a781-107b73c45e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b3cc5b-a12f-453a-8646-25ed0556937e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea24c86-bbbb-421a-8e3d-51c302b00a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:35 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Volume volume-79b3cc5b-a12f-453a-8646-25ed0556937e (79b3cc5b-a12f-453a-8646-25ed0556937e): created successfully Apr 13 17:43:35 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 1073741824 Apr 13 17:43:35 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea24c86-bbbb-421a-8e3d-51c302b00a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Flow 'volume_create_manager' (0029991c-1e0d-4465-82b0-76ec20fa8052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-bac94a83-896c-4209-ae3b-56b7b25231fd req-a4a8267b-4650-4582-9566-a3f238c85c62 tempest-VolumesGetTestJSON-481472769 None] Created volume successfully. Apr 13 17:43:35 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 1073741824" returned: 0 in 0.693s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:35 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 Apr 13 17:43:35 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Acquiring lock "cinder-79b3cc5b-a12f-453a-8646-25ed0556937e-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Lock "cinder-79b3cc5b-a12f-453a-8646-25ed0556937e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Acquiring lock "cinder-quobyte-79b3cc5b-a12f-453a-8646-25ed0556937e" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Lock "cinder-quobyte-79b3cc5b-a12f-453a-8646-25ed0556937e" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc01c99f-2988-4205-a657-7151f4f70118]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:35 devstack sudo[84955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e Apr 13 17:43:35 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:36 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7" returned: 0 in 0.664s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f842137a-96ab-49cb-8a00-723a431b84be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c078a3-acba-4580-8e17-cb4758fc21e7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc03545-fdaf-4bb4-8206-45e0fe0993d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:36 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Volume volume-68c078a3-acba-4580-8e17-cb4758fc21e7 (68c078a3-acba-4580-8e17-cb4758fc21e7): created successfully Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc03545-fdaf-4bb4-8206-45e0fe0993d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Flow 'volume_create_manager' (703fd43c-f242-406d-ab85-818f86fdbcaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:36 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-26abe815-bac6-41ce-8d05-d34f43af354b tempest-VolumesTestJSON-802708454 None] Created volume successfully. Apr 13 17:43:36 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e" returned: 0 in 0.651s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:36 devstack sudo[84987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e Apr 13 17:43:36 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:37 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-79b3cc5b-a12f-453a-8646-25ed0556937e" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Lock "cinder-quobyte-79b3cc5b-a12f-453a-8646-25ed0556937e" released by "delete_volume" :: held 1.225s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.quota [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Created reservations ['765164c6-1954-400b-951f-1f5d536620e8', 'c21e2084-89d1-4ad6-b4bd-3590847c3b91', '04f5efd8-76e4-46fb-b11e-5a74f9acd40f', 'efa291f0-b08a-4cad-be87-d16dd8596ec3'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:37 devstack sudo[85014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:37 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:37 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.548s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.manager [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Deleted volume successfully. Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-6f8b4333-9ca3-4275-a5e3-5df58c20ebba req-8881dc91-e9b8-4fb9-9a6e-4f39acc4f05c tempest-VolumesGetTestJSON-481472769 None] Lock "cinder-79b3cc5b-a12f-453a-8646-25ed0556937e-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Flow 'volume_create_manager' (ded2499c-ba16-4927-b036-2376545bf7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b27d06-f9fb-4784-a59a-8035b9463ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b27d06-f9fb-4784-a59a-8035b9463ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1866919084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f0492a-cf2b-459a-bb3e-7041cc338545,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4b73cfefa0b4362bd302ad23b38855a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:38Z,use_quota=True,user_id='d671d609270f434f84e45bd2907c2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff86c434-b266-471b-879a-9178e2d3cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff86c434-b266-471b-879a-9178e2d3cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021f5bda-ef54-4436-9cd1-1998c94fdf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021f5bda-ef54-4436-9cd1-1998c94fdf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f0492a-cf2b-459a-bb3e-7041cc338545', 'volume_name': 'volume-c8f0492a-cf2b-459a-bb3e-7041cc338545', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2121d46-00d7-4fb7-951a-fda42b76ccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2121d46-00d7-4fb7-951a-fda42b76ccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff8bb05-b4ba-4163-b18b-18f0651757a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:37 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Volume c8f0492a-cf2b-459a-bb3e-7041cc338545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f0492a-cf2b-459a-bb3e-7041cc338545', 'volume_size': 1} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1866919084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f0492a-cf2b-459a-bb3e-7041cc338545,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4b73cfefa0b4362bd302ad23b38855a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:38Z,use_quota=True,user_id='d671d609270f434f84e45bd2907c2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Creating volume c8f0492a-cf2b-459a-bb3e-7041cc338545 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:43:37 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:43:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:37 devstack sudo[85018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 1073741824 Apr 13 17:43:37 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:38 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 1073741824" returned: 0 in 0.632s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:38 devstack sudo[85027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 Apr 13 17:43:38 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:39 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545" returned: 0 in 0.493s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:43:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff8bb05-b4ba-4163-b18b-18f0651757a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f0492a-cf2b-459a-bb3e-7041cc338545', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf8b08d-f54d-49f6-8bd3-7411572066a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:39 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Volume volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 (c8f0492a-cf2b-459a-bb3e-7041cc338545): created successfully Apr 13 17:43:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf8b08d-f54d-49f6-8bd3-7411572066a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Flow 'volume_create_manager' (ded2499c-ba16-4927-b036-2376545bf7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:39 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-778f9128-144c-44b5-84f0-e5614fafdcf5 tempest-VolumesTestJSON-802708454 None] Created volume successfully. Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Flow 'volume_create_manager' (c811abb8-0bca-4a68-890d-cbab9bb191e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9400a11-b91f-4493-b04a-24cbe6e8cbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9400a11-b91f-4493-b04a-24cbe6e8cbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2118402774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6de5117-ff30-47e6-9e46-35c6b36e8eb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4b73cfefa0b4362bd302ad23b38855a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:40Z,use_quota=True,user_id='d671d609270f434f84e45bd2907c2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a44b21-7480-4b01-8df3-91a3e0ca93f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a44b21-7480-4b01-8df3-91a3e0ca93f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3325e7-af4c-4da2-b09e-0c3f869dd643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3325e7-af4c-4da2-b09e-0c3f869dd643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6de5117-ff30-47e6-9e46-35c6b36e8eb5', 'volume_name': 'volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1232bca3-c541-4a44-9a4a-9567214626d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1232bca3-c541-4a44-9a4a-9567214626d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991aee61-63ee-48b3-9f08-ca65c36d78f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:40 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Volume a6de5117-ff30-47e6-9e46-35c6b36e8eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5', 'volume_size': 1} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2118402774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6de5117-ff30-47e6-9e46-35c6b36e8eb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a4b73cfefa0b4362bd302ad23b38855a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:40Z,use_quota=True,user_id='d671d609270f434f84e45bd2907c2a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Creating volume a6de5117-ff30-47e6-9e46-35c6b36e8eb5 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:43:40 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:43:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:40 devstack sudo[85064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 1073741824 Apr 13 17:43:40 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:41 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 1073741824" returned: 0 in 0.800s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:41 devstack sudo[85072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 Apr 13 17:43:41 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:41 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5" returned: 0 in 0.492s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991aee61-63ee-48b3-9f08-ca65c36d78f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60703c79-8ef5-4ad1-885f-611044add918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:41 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Volume volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 (a6de5117-ff30-47e6-9e46-35c6b36e8eb5): created successfully Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60703c79-8ef5-4ad1-885f-611044add918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Flow 'volume_create_manager' (c811abb8-0bca-4a68-890d-cbab9bb191e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:41 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-53e6df12-b138-4a99-b9f1-c875d373b41a tempest-VolumesTestJSON-802708454 None] Created volume successfully. Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Flow 'volume_create_manager' (c513c2f4-058f-4aab-82c9-4af19bee6487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de3afd6-d01c-4412-ab06-39a9ecc980a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Acquiring lock "cinder-a6de5117-ff30-47e6-9e46-35c6b36e8eb5-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de3afd6-d01c-4412-ab06-39a9ecc980a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-366690501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8af587-c66c-49d3-922b-412761f80798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e265bba14948c28201b69a2a15cbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:43Z,use_quota=True,user_id='71beb07655f847059d7d3f0a82c41346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b5cb26-902a-45ea-bc23-023b10b23213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b5cb26-902a-45ea-bc23-023b10b23213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53841feb-2810-4707-93fd-a79c3b6cdc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53841feb-2810-4707-93fd-a79c3b6cdc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8af587-c66c-49d3-922b-412761f80798', 'volume_name': 'volume-af8af587-c66c-49d3-922b-412761f80798', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d7fb29-021d-40cb-8f9d-ca61d063cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d7fb29-021d-40cb-8f9d-ca61d063cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50eedb13-affd-4d08-9d0e-e49cd21b7e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:43 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Volume af8af587-c66c-49d3-922b-412761f80798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8af587-c66c-49d3-922b-412761f80798', 'volume_size': 1} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-366690501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8af587-c66c-49d3-922b-412761f80798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e265bba14948c28201b69a2a15cbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:43:43Z,use_quota=True,user_id='71beb07655f847059d7d3f0a82c41346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Creating volume af8af587-c66c-49d3-922b-412761f80798 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:43:43 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Lock "cinder-a6de5117-ff30-47e6-9e46-35c6b36e8eb5-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:43 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 1073741824 Apr 13 17:43:43 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Acquiring lock "cinder-quobyte-a6de5117-ff30-47e6-9e46-35c6b36e8eb5" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Lock "cinder-quobyte-a6de5117-ff30-47e6-9e46-35c6b36e8eb5" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[de84f9d0-a3c2-4d16-bce0-5d002be371cd]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:43 devstack sudo[85079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 Apr 13 17:43:43 devstack sudo[85079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a5d628ce-6dca-4831-bd77-95438ad625e1 tempest-BackendsCapabilitiesAdminTestsJSON-142246678 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82736) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4ccf53b0-5c6e-4a6e-aba9-c85b17d424c8 tempest-BackendsCapabilitiesAdminTestsJSON-142246678 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579917907715, 'free_capacity_gb': 1775.7579917907715, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82736) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 17:43:44 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 1073741824" returned: 0 in 0.692s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:44 devstack sudo[85079]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5" returned: 0 in 0.659s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:44 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 Apr 13 17:43:44 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:44 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5 Apr 13 17:43:44 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:44 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798" returned: 0 in 0.487s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50eedb13-affd-4d08-9d0e-e49cd21b7e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8af587-c66c-49d3-922b-412761f80798', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6ee55a-eff6-4474-b756-584568ddd917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:43:44 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Volume volume-af8af587-c66c-49d3-922b-412761f80798 (af8af587-c66c-49d3-922b-412761f80798): created successfully Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6ee55a-eff6-4474-b756-584568ddd917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Flow 'volume_create_manager' (c513c2f4-058f-4aab-82c9-4af19bee6487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:43:44 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-714d1dff-a709-4d9e-8b1f-1768db6e3a1b tempest-VolumesAdminNegativeTest-324577358 None] Created volume successfully. Apr 13 17:43:44 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a6de5117-ff30-47e6-9e46-35c6b36e8eb5" returned: 0 in 0.568s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Lock "cinder-quobyte-a6de5117-ff30-47e6-9e46-35c6b36e8eb5" released by "delete_volume" :: held 1.269s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Created reservations ['76b75f48-3e25-4e17-b8ff-c92f9229bf51', '0f1db586-1b26-439c-916f-ab989d8abc78', 'c3877ded-1d9d-44d2-8c6f-b9c11e8db169', '4e39040e-b8ec-4788-97f4-2be01d67adb2'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:45 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:45 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:45 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.671s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:45 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Deleted volume successfully. Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Acquiring lock "cinder-c8f0492a-cf2b-459a-bb3e-7041cc338545-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d8a85ac8-68d7-40d4-978f-f4a2e0ac2fdc tempest-VolumesTestJSON-802708454 None] Lock "cinder-a6de5117-ff30-47e6-9e46-35c6b36e8eb5-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Lock "cinder-c8f0492a-cf2b-459a-bb3e-7041cc338545-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Acquiring lock "cinder-quobyte-c8f0492a-cf2b-459a-bb3e-7041cc338545" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Lock "cinder-quobyte-c8f0492a-cf2b-459a-bb3e-7041cc338545" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[897f06dd-8f7b-472b-a68e-f446ed660e51]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:46 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 Apr 13 17:43:46 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Acquiring lock "cinder-af8af587-c66c-49d3-922b-412761f80798-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Lock "cinder-af8af587-c66c-49d3-922b-412761f80798-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Acquiring lock "cinder-quobyte-af8af587-c66c-49d3-922b-412761f80798" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Lock "cinder-quobyte-af8af587-c66c-49d3-922b-412761f80798" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:46 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a39e5cc-9441-4c65-a75d-4f9906247a02]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:46 devstack sudo[85115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 Apr 13 17:43:46 devstack sudo[85115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:46 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545" returned: 0 in 0.813s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:46 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545 Apr 13 17:43:46 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:47 devstack sudo[85115]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798" returned: 0 in 0.783s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:47 devstack sudo[85125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798 Apr 13 17:43:47 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:47 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c8f0492a-cf2b-459a-bb3e-7041cc338545" returned: 0 in 0.620s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Lock "cinder-quobyte-c8f0492a-cf2b-459a-bb3e-7041cc338545" released by "delete_volume" :: held 1.454s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Created reservations ['c0539da6-dd20-4aca-8a63-78ecead24f98', 'c8e92823-b338-47c9-93b3-c513f44eb604', '071e5c6a-2bd6-426a-9bbb-06360516a308', '1cdbd3a7-4db4-48ae-b164-1fffb918a116'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:47 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:47 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:47 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-af8af587-c66c-49d3-922b-412761f80798" returned: 0 in 0.538s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Lock "cinder-quobyte-af8af587-c66c-49d3-922b-412761f80798" released by "delete_volume" :: held 1.348s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Created reservations ['331cf8d1-dccd-4ee9-9da5-f06aae14aa11', '321dd1f1-de5b-4f82-973b-60dec726f43c', '04e07ac1-dee7-460f-928e-c55af435ef7f', 'b9479007-91b9-4654-8068-86531d3efc3b'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:47 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:47 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:47 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.540s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:48 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Deleted volume successfully. Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Acquiring lock "cinder-68c078a3-acba-4580-8e17-cb4758fc21e7-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-01a0ea48-6d51-4516-bdeb-786cf0b73ff1 tempest-VolumesTestJSON-802708454 None] Lock "cinder-c8f0492a-cf2b-459a-bb3e-7041cc338545-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Lock "cinder-68c078a3-acba-4580-8e17-cb4758fc21e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Acquiring lock "cinder-quobyte-68c078a3-acba-4580-8e17-cb4758fc21e7" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Lock "cinder-quobyte-68c078a3-acba-4580-8e17-cb4758fc21e7" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f0262a-fb8d-4c2e-bcd5-7b802e72370e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:48 devstack sudo[85138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 Apr 13 17:43:48 devstack sudo[85138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:48 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.620s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:48 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Deleted volume successfully. Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-89a0e963-45d3-42f5-a14a-001fdf88ce7f tempest-VolumesAdminNegativeTest-324577358 None] Lock "cinder-af8af587-c66c-49d3-922b-412761f80798-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:48 devstack sudo[85138]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7" returned: 0 in 0.683s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:48 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7 Apr 13 17:43:48 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:49 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-68c078a3-acba-4580-8e17-cb4758fc21e7" returned: 0 in 0.460s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Lock "cinder-quobyte-68c078a3-acba-4580-8e17-cb4758fc21e7" released by "delete_volume" :: held 1.172s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Created reservations ['6676b423-c574-45ad-a7b4-3839c3fa8926', '15dc7e7f-049c-48f4-9466-5ad488f5cdab', '3290b3ba-2225-4284-a902-51930edcd973', '894532d4-fc92-4399-80d9-4a150f2e971b'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:49 devstack sudo[85148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:49 devstack sudo[85148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:50 devstack sudo[85148]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.826s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:50 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:50 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Deleted volume successfully. Apr 13 17:43:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-da73393b-6703-4315-9d3b-6ded8eb525e6 tempest-VolumesTestJSON-802708454 None] Lock "cinder-68c078a3-acba-4580-8e17-cb4758fc21e7-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:43:53 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e173d588-c1d4-449f-963e-f6b0419bb636 tempest-GroupsV320Test-1244703703 None] Group tempest-GroupsV320Test-Group-2083399658: creating Apr 13 17:43:53 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e173d588-c1d4-449f-963e-f6b0419bb636 tempest-GroupsV320Test-1244703703 None] Group tempest-GroupsV320Test-Group-2083399658: created successfully Apr 13 17:43:53 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e173d588-c1d4-449f-963e-f6b0419bb636 tempest-GroupsV320Test-1244703703 None] Create group completed successfully. Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Created reservations ['e9e4c449-a6e0-4777-a68c-dcecc8be2f8a'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:43:55 devstack sudo[85212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:43:55 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:43:55 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.597s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:43:55 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:43:55 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-87dd3ba0-1145-44cb-8ce0-8983e13b79a1 tempest-GroupsV320Test-1244703703 None] Delete group completed successfully. Apr 13 17:43:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4d426969-ef6d-4da6-b901-8a6f032c1338 tempest-GroupsTest-2123514569 None] Group tempest-Group1-682810716: creating Apr 13 17:43:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4d426969-ef6d-4da6-b901-8a6f032c1338 tempest-GroupsTest-2123514569 None] Group tempest-Group1-682810716: created successfully Apr 13 17:43:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4d426969-ef6d-4da6-b901-8a6f032c1338 tempest-GroupsTest-2123514569 None] Create group completed successfully. Apr 13 17:43:58 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3e6a8235-c3fa-4bcd-a79a-c1939d78e43b tempest-GroupsTest-2123514569 None] Group tempest-Group2-1144198022: creating Apr 13 17:43:58 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3e6a8235-c3fa-4bcd-a79a-c1939d78e43b tempest-GroupsTest-2123514569 None] Group tempest-Group2-1144198022: created successfully Apr 13 17:43:58 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3e6a8235-c3fa-4bcd-a79a-c1939d78e43b tempest-GroupsTest-2123514569 None] Create group completed successfully. Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Flow 'volume_create_manager' (b7e2ed9c-066d-40a6-a348-a1edb3913e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19af8a9-0d76-4a95-a52a-605252bc8cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19af8a9-0d76-4a95-a52a-605252bc8cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42064737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d1cdf2a-8fb1-45e2-821e-99ebf857659a,host='devstack@QuobyteHD#QuobyteHD',id=f82b1cb8-8eb3-49fe-84fa-f9883f47208c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='776aefe2aabe42ea9a0f2d92035b50d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:01Z,use_quota=True,user_id='9a23dfe400ae45d0af44c4d75efe5949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c26f505-0900-4d81-a695-9a1981be6cf5),volume_type_id=0c26f505-0900-4d81-a695-9a1981be6cf5)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a896dbf-3c08-456f-ba8b-cce3648e7ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a896dbf-3c08-456f-ba8b-cce3648e7ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a416d399-7fd4-4fa6-9c7b-d0a2ecd0f1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a416d399-7fd4-4fa6-9c7b-d0a2ecd0f1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82b1cb8-8eb3-49fe-84fa-f9883f47208c', 'volume_name': 'volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6691806-8e32-457f-8a0f-958c0f60a67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6691806-8e32-457f-8a0f-958c0f60a67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182a88a8-d886-4518-8d00-820f5880c7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:00 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Volume f82b1cb8-8eb3-49fe-84fa-f9883f47208c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c', 'volume_size': 1} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d1cdf2a-8fb1-45e2-821e-99ebf857659a,created_at=2026-04-13T15:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-42064737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d1cdf2a-8fb1-45e2-821e-99ebf857659a,host='devstack@QuobyteHD#QuobyteHD',id=f82b1cb8-8eb3-49fe-84fa-f9883f47208c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='776aefe2aabe42ea9a0f2d92035b50d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:01Z,use_quota=True,user_id='9a23dfe400ae45d0af44c4d75efe5949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c26f505-0900-4d81-a695-9a1981be6cf5),volume_type_id=0c26f505-0900-4d81-a695-9a1981be6cf5)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Creating volume f82b1cb8-8eb3-49fe-84fa-f9883f47208c {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:00 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:00 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c 1073741824 Apr 13 17:44:00 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:01 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c 1073741824" returned: 0 in 0.748s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:01 devstack sudo[85274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c Apr 13 17:44:01 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:02 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c" returned: 0 in 0.646s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182a88a8-d886-4518-8d00-820f5880c7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c32e91-2e78-451b-ba26-21c1285ffd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:02 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Volume volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c (f82b1cb8-8eb3-49fe-84fa-f9883f47208c): created successfully Apr 13 17:44:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c32e91-2e78-451b-ba26-21c1285ffd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Flow 'volume_create_manager' (b7e2ed9c-066d-40a6-a348-a1edb3913e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:02 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d779d6b2-16c9-43da-b112-6110b3627257 tempest-GroupsTest-2123514569 None] Created volume successfully. Apr 13 17:44:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Acquiring lock "cinder-quobyte-f82b1cb8-8eb3-49fe-84fa-f9883f47208c" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Lock "cinder-quobyte-f82b1cb8-8eb3-49fe-84fa-f9883f47208c" acquired by "delete_volume" :: waited 0.018s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:03 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[944acc31-88f3-435d-b19d-bdeeaa99a76a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:03 devstack sudo[85283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c Apr 13 17:44:03 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:03 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c" returned: 0 in 0.601s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:03 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c Apr 13 17:44:03 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:04 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f82b1cb8-8eb3-49fe-84fa-f9883f47208c" returned: 0 in 0.668s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Lock "cinder-quobyte-f82b1cb8-8eb3-49fe-84fa-f9883f47208c" released by "delete_volume" :: held 1.324s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Created reservations ['abfab77a-f08e-4b50-84c1-ca6b8f7c52fd'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:04 devstack cinder-volume[82736]: WARNING cinder.quota [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1422349964 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1422349964, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:44:04 devstack cinder-volume[82736]: WARNING cinder.quota [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1422349964 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1422349964, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Created reservations ['883c365c-0820-4dca-9977-0eee71bd9635', '2499e1a8-86d7-45c3-8796-a450cda61da6', '6df4bd85-21ba-4c2d-b361-0329794e0308', 'd721beb1-a7ce-4d91-a868-8d75d40656c2'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:04 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:44:04 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:05 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.583s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:44:05 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-840f9d67-9003-424e-b77a-75bb2bba91d3 tempest-GroupsTest-2123514569 None] Delete group completed successfully. Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Created reservations ['41157a24-c0f6-438b-83dd-021b1c5d51bf'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:05 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:44:05 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:06 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.539s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:06 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:44:06 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-40250ea3-3947-485f-ae42-be6753ede332 tempest-GroupsTest-2123514569 None] Delete group completed successfully. Apr 13 17:44:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1457cde2-1103-43ad-b906-d04329cd9c7b tempest-GroupsTest-2123514569 None] Group tempest-GroupsTest-Group-1488540414: creating Apr 13 17:44:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1457cde2-1103-43ad-b906-d04329cd9c7b tempest-GroupsTest-2123514569 None] Group tempest-GroupsTest-Group-1488540414: created successfully Apr 13 17:44:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1457cde2-1103-43ad-b906-d04329cd9c7b tempest-GroupsTest-2123514569 None] Create group completed successfully. Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Flow 'volume_create_manager' (1255ae2d-c57b-49cc-8dee-86d98d5adffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfa7f96-517e-44a2-8f24-cc841ec934e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfa7f96-517e-44a2-8f24-cc841ec934e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1663337358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee6201a9-1e68-45fd-a4c8-75196cdd3fa9,host='devstack@QuobyteHD#QuobyteHD',id=c6976514-381a-4e95-881a-5850f8127777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='776aefe2aabe42ea9a0f2d92035b50d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:09Z,use_quota=True,user_id='9a23dfe400ae45d0af44c4d75efe5949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2833cd7-55ac-47f2-82b6-46f7b3162d2d),volume_type_id=e2833cd7-55ac-47f2-82b6-46f7b3162d2d)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553acedb-5c90-4518-a616-7df12c27dbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553acedb-5c90-4518-a616-7df12c27dbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f95e95-a57b-41b5-9c6f-3c0bc1fdc3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f95e95-a57b-41b5-9c6f-3c0bc1fdc3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6976514-381a-4e95-881a-5850f8127777', 'volume_name': 'volume-c6976514-381a-4e95-881a-5850f8127777', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26213b18-cf23-41f6-a61e-8b5652b350bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26213b18-cf23-41f6-a61e-8b5652b350bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450978fe-09cb-4479-914c-f5eac084dfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:09 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Volume c6976514-381a-4e95-881a-5850f8127777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6976514-381a-4e95-881a-5850f8127777', 'volume_size': 1} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ee6201a9-1e68-45fd-a4c8-75196cdd3fa9,created_at=2026-04-13T15:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1663337358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee6201a9-1e68-45fd-a4c8-75196cdd3fa9,host='devstack@QuobyteHD#QuobyteHD',id=c6976514-381a-4e95-881a-5850f8127777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='776aefe2aabe42ea9a0f2d92035b50d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:09Z,use_quota=True,user_id='9a23dfe400ae45d0af44c4d75efe5949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2833cd7-55ac-47f2-82b6-46f7b3162d2d),volume_type_id=e2833cd7-55ac-47f2-82b6-46f7b3162d2d)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Creating volume c6976514-381a-4e95-881a-5850f8127777 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:09 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:09 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 1073741824 Apr 13 17:44:09 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Flow 'volume_create_manager' (1bb61268-e69e-4910-b720-1499ce3994d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f5e057-19c2-4dec-88b7-a49f5398a169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f5e057-19c2-4dec-88b7-a49f5398a169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:09Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ab7068-c47c-4d7b-9751-9b4464b2de43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993df86383d340429ff38a0aa77f336d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:09Z,use_quota=True,user_id='d61c0c401dc3460db3f1d4d47d73759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d9b1f3-a0d9-48c6-8585-9965c681a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d9b1f3-a0d9-48c6-8585-9965c681a62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e2f377-2e4f-42df-9358-464485d00934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.image.glance [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Creating Keystone auth plugin from conf {{(pid=82736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:09 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:44:09 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e2f377-2e4f-42df-9358-464485d00934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2ab7068-c47c-4d7b-9751-9b4464b2de43', 'volume_name': 'volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63921968-329e-4f21-a85d-3de5a901e8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63921968-329e-4f21-a85d-3de5a901e8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f9ddbf-27ac-4563-8674-b151dc849424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:10 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Volume c2ab7068-c47c-4d7b-9751-9b4464b2de43: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Trying to clone c2ab7068-c47c-4d7b-9751-9b4464b2de43 from image c37de8a8-6952-44d2-a609-d35b5a83220f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]). {{(pid=82736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 13 17:44:10 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.648s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 17:44:10 devstack cinder-volume[82736]: INFO cinder.image.image_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Image download 20.69 MB at 20.69 MB/s Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[493da9d8-d3c1-4dc5-9b44-18dc608bd2db]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:10 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Flow 'volume_create_manager' (d4bb61d7-6f91-4258-997b-a312b68619b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048b9a17-22e9-44d8-b4e5-6998580a3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:10 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD Apr 13 17:44:10 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048b9a17-22e9-44d8-b4e5-6998580a3a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-327437722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07745f08-b3e6-41e6-9f76-634b03ee9d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8cb4faf02f40f994856aab724eb85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:11Z,use_quota=True,user_id='7bce14c00a4447f89565b3623d640d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3cef96-6481-469d-9cb5-4bad3633fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3cef96-6481-469d-9cb5-4bad3633fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e57c616-d2b0-434b-b757-7fbf9fa58be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e57c616-d2b0-434b-b757-7fbf9fa58be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07745f08-b3e6-41e6-9f76-634b03ee9d76', 'volume_name': 'volume-07745f08-b3e6-41e6-9f76-634b03ee9d76', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a124c630-a9ee-4a9d-b867-543a9502835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a124c630-a9ee-4a9d-b867-543a9502835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80c9cc9-3977-46ac-93cb-f5ddea132053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:10 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Volume 07745f08-b3e6-41e6-9f76-634b03ee9d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07745f08-b3e6-41e6-9f76-634b03ee9d76', 'volume_size': 1} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 1073741824" returned: 0 in 1.319s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:10 devstack sudo[85358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 Apr 13 17:44:10 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:11 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD" returned: 0 in 0.642s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Temporary image c37de8a8-6952-44d2-a609-d35b5a83220f is fetched for user d61c0c401dc3460db3f1d4d47d73759a. {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecfbaac-cee3-47b7-b839-b3b33b243475]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:11 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777" returned: 0 in 0.616s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-327437722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07745f08-b3e6-41e6-9f76-634b03ee9d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8cb4faf02f40f994856aab724eb85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:11Z,use_quota=True,user_id='7bce14c00a4447f89565b3623d640d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Creating volume 07745f08-b3e6-41e6-9f76-634b03ee9d76 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:11 devstack sudo[85368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD Apr 13 17:44:11 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:11 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450978fe-09cb-4479-914c-f5eac084dfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6976514-381a-4e95-881a-5850f8127777', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8083ef-a84d-4209-abc6-08259c19073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:11 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 1073741824 Apr 13 17:44:11 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:11 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Volume volume-c6976514-381a-4e95-881a-5850f8127777 (c6976514-381a-4e95-881a-5850f8127777): created successfully Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8083ef-a84d-4209-abc6-08259c19073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Flow 'volume_create_manager' (1255ae2d-c57b-49cc-8dee-86d98d5adffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:11 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-924631f8-924f-4f25-a6ca-d3498c3c3eb3 tempest-GroupsTest-2123514569 None] Created volume successfully. Apr 13 17:44:12 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD" returned: 0 in 0.674s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:12 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 1073741824" returned: 0 in 0.881s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:12 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 Apr 13 17:44:12 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:12 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76" returned: 0 in 0.544s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:09Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ab7068-c47c-4d7b-9751-9b4464b2de43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993df86383d340429ff38a0aa77f336d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:09Z,use_quota=True,user_id='d61c0c401dc3460db3f1d4d47d73759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Creating volume c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:12 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80c9cc9-3977-46ac-93cb-f5ddea132053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07745f08-b3e6-41e6-9f76-634b03ee9d76', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fe7c05-6497-49fa-8c0b-06f5b298ef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:12 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 1073741824 Apr 13 17:44:12 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:12 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Volume volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 (07745f08-b3e6-41e6-9f76-634b03ee9d76): created successfully Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fe7c05-6497-49fa-8c0b-06f5b298ef4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Flow 'volume_create_manager' (d4bb61d7-6f91-4258-997b-a312b68619b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:12 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-86bf13cd-84cf-4f38-b45f-309841e86dda tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Created volume successfully. Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Flow 'volume_create_manager' (ba823ea9-d98a-4075-8999-23b93556cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04df3f4a-ca22-45e3-9842-7af31c6c4724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04df3f4a-ca22-45e3-9842-7af31c6c4724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2044656088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee6201a9-1e68-45fd-a4c8-75196cdd3fa9,host='devstack@QuobyteHD#QuobyteHD',id=0eedc669-55ab-4895-857f-83e5a8eeb874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='776aefe2aabe42ea9a0f2d92035b50d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:13Z,use_quota=True,user_id='9a23dfe400ae45d0af44c4d75efe5949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2833cd7-55ac-47f2-82b6-46f7b3162d2d),volume_type_id=e2833cd7-55ac-47f2-82b6-46f7b3162d2d)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918d5e97-1ae5-4d58-84ae-2b919db369dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918d5e97-1ae5-4d58-84ae-2b919db369dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bccfa8-a61a-4c07-9486-f993cd6f8623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bccfa8-a61a-4c07-9486-f993cd6f8623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eedc669-55ab-4895-857f-83e5a8eeb874', 'volume_name': 'volume-0eedc669-55ab-4895-857f-83e5a8eeb874', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712baf6e-0615-4321-84fd-770cbecf0175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712baf6e-0615-4321-84fd-770cbecf0175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50feec3-0043-48c7-986b-6e9db31f0c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:13 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Volume 0eedc669-55ab-4895-857f-83e5a8eeb874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eedc669-55ab-4895-857f-83e5a8eeb874', 'volume_size': 1} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:13 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 1073741824" returned: 0 in 0.759s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:13 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:13 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:14 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 0 in 0.582s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.873s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ee6201a9-1e68-45fd-a4c8-75196cdd3fa9,created_at=2026-04-13T15:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2044656088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee6201a9-1e68-45fd-a4c8-75196cdd3fa9,host='devstack@QuobyteHD#QuobyteHD',id=0eedc669-55ab-4895-857f-83e5a8eeb874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='776aefe2aabe42ea9a0f2d92035b50d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:13Z,use_quota=True,user_id='9a23dfe400ae45d0af44c4d75efe5949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2833cd7-55ac-47f2-82b6-46f7b3162d2d),volume_type_id=e2833cd7-55ac-47f2-82b6-46f7b3162d2d)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Creating volume 0eedc669-55ab-4895-857f-83e5a8eeb874 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:14 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:14 devstack sudo[85391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 1073741824 Apr 13 17:44:14 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Attempting download of c37de8a8-6952-44d2-a609-d35b5a83220f ((None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}])) to volume c2ab7068-c47c-4d7b-9751-9b4464b2de43. {{(pid=82736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eb1df7-adaa-43b8-9fd4-2fe0e3b5af5e]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_4no3s8i6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:14 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_4no3s8i6 Apr 13 17:44:14 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:14 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 1073741824" returned: 0 in 0.575s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:14 devstack sudo[85398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 Apr 13 17:44:14 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:15 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_4no3s8i6" returned: 0 in 0.647s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_4no3s8i6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:15 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_4no3s8i6 Apr 13 17:44:15 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:15 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874" returned: 0 in 0.587s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.455s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Creating offline snapshot 5f7d042d-4112-40a7-980c-88e76007f123 of volume 07745f08-b3e6-41e6-9f76-634b03ee9d76 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50feec3-0043-48c7-986b-6e9db31f0c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eedc669-55ab-4895-857f-83e5a8eeb874', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbad4bef-3d1a-4d8c-9e9f-5f1f75be16bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcf0259-2602-442c-ae4d-3492a5549701]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Volume volume-0eedc669-55ab-4895-857f-83e5a8eeb874 (0eedc669-55ab-4895-857f-83e5a8eeb874): created successfully Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbad4bef-3d1a-4d8c-9e9f-5f1f75be16bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Flow 'volume_create_manager' (ba823ea9-d98a-4075-8999-23b93556cf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:15 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ab0f6bba-2792-493c-867f-ebf6abedc4b1 tempest-GroupsTest-2123514569 None] Created volume successfully. Apr 13 17:44:15 devstack sudo[85405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 Apr 13 17:44:15 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:15 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_4no3s8i6" returned: 1 in 0.860s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_4no3s8i6' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b1fb48-28c9-42a5-baf1-05a605b35d34]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:16 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD Apr 13 17:44:16 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:16 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76" returned: 0 in 0.884s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:16 devstack sudo[85417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 1G Apr 13 17:44:16 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:16 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:16 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] c37de8a8-6952-44d2-a609-d35b5a83220f was qcow2, converting to raw {{(pid=82736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 17:44:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:16 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:16 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:16 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-05f84ebf-32af-4c5b-a066-e3c6e428825b tempest-GroupsTest-2123514569 None] Update group completed successfully. Apr 13 17:44:17 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 1G" returned: 0 in 1.014s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:17 devstack sudo[85432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 Apr 13 17:44:17 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:18 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 0 in 1.234s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:18 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f__a6txdpfdevstack@QuobyteHD, size 112.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:44:18 devstack cinder-volume[82736]: INFO cinder.image.image_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Converted 112.00 MB image at 90.59 MB/s Apr 13 17:44:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:18 devstack sudo[85434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 1G Apr 13 17:44:18 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a34d2e9d-45cb-48b9-bfb3-9955bd92e6da tempest-GroupsTest-2123514569 None] Update group completed successfully. Apr 13 17:44:18 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123" returned: 0 in 0.838s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:18 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 is being set with open permissions: ugo+rw Apr 13 17:44:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:18 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 Apr 13 17:44:18 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:18 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123" returned: 0 in 0.605s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:18 devstack sudo[85445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.info Apr 13 17:44:18 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:19 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 1G" returned: 0 in 0.953s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1561d8-a8d7-4ea0-b850-9aa655f7e693]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:19 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:19 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Acquiring lock "cinder-quobyte-0eedc669-55ab-4895-857f-83e5a8eeb874" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Lock "cinder-quobyte-0eedc669-55ab-4895-857f-83e5a8eeb874" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff27df8-d240-4121-a0ca-37d471f63ab0]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:19 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.info" returned: 0 in 0.833s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:19 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.info is being set with open permissions: ugo+rw Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:19 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.info Apr 13 17:44:19 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:19 devstack sudo[85451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 Apr 13 17:44:19 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:19 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 0 in 0.833s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:20 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:20 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:20 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.info" returned: 0 in 0.649s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.907s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:20 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4d2ab41b-37f5-452b-b4de-dc2be222d766 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Create snapshot completed successfully Apr 13 17:44:20 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874" returned: 0 in 0.790s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:20 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874 Apr 13 17:44:20 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:20 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 1 in 0.779s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Downloaded image c37de8a8-6952-44d2-a609-d35b5a83220f ((None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}])) to volume c2ab7068-c47c-4d7b-9751-9b4464b2de43 successfully. {{(pid=82736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Temporary image c37de8a8-6952-44d2-a609-d35b5a83220f for user d61c0c401dc3460db3f1d4d47d73759a is deleted. {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Marking volume c2ab7068-c47c-4d7b-9751-9b4464b2de43 as bootable. {{(pid=82736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Copying metadata from image c37de8a8-6952-44d2-a609-d35b5a83220f to c2ab7068-c47c-4d7b-9751-9b4464b2de43. {{(pid=82736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Creating volume glance metadata for volume c2ab7068-c47c-4d7b-9751-9b4464b2de43 backed by image c37de8a8-6952-44d2-a609-d35b5a83220f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f9ddbf-27ac-4563-8674-b151dc849424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650ecd27-0c3a-442a-a4b0-84eb47af2f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:20 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Volume volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 (c2ab7068-c47c-4d7b-9751-9b4464b2de43): created successfully Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650ecd27-0c3a-442a-a4b0-84eb47af2f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Flow 'volume_create_manager' (1bb61268-e69e-4910-b720-1499ce3994d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:20 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-c2ec930f-a38b-4492-91c0-4a42327f8ecc tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Created volume successfully. Apr 13 17:44:20 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-0eedc669-55ab-4895-857f-83e5a8eeb874" returned: 0 in 0.461s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Lock "cinder-quobyte-0eedc669-55ab-4895-857f-83e5a8eeb874" released by "delete_volume" :: held 1.316s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Acquiring lock "cinder-quobyte-c6976514-381a-4e95-881a-5850f8127777" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Lock "cinder-quobyte-c6976514-381a-4e95-881a-5850f8127777" acquired by "delete_volume" :: waited 0.005s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b140d57-0014-45e1-b290-b1e1da306319]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:21 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 Apr 13 17:44:21 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:21 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777" returned: 0 in 0.529s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:21 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777 Apr 13 17:44:21 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "cinder-5f7d042d-4112-40a7-980c-88e76007f123-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-5f7d042d-4112-40a7-980c-88e76007f123-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "cinder-quobyte-07745f08-b3e6-41e6-9f76-634b03ee9d76" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-quobyte-07745f08-b3e6-41e6-9f76-634b03ee9d76" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "cinder-quobyte-5f7d042d-4112-40a7-980c-88e76007f123" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-quobyte-5f7d042d-4112-40a7-980c-88e76007f123" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Deleting offline snapshot 5f7d042d-4112-40a7-980c-88e76007f123 of volume 07745f08-b3e6-41e6-9f76-634b03ee9d76 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] snapshot_file for this snap is: volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d11b10-7c19-42e0-93be-2b23b8684330]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:21 devstack sudo[85481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 Apr 13 17:44:21 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:21 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c6976514-381a-4e95-881a-5850f8127777" returned: 0 in 0.449s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Lock "cinder-quobyte-c6976514-381a-4e95-881a-5850f8127777" released by "delete_volume" :: held 1.004s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Created reservations ['e348fe03-9f5b-46cb-a1b5-94311a5ffca1'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[22985ecc-6ed4-495e-b903-61344f037fff]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:22 devstack cinder-volume[82736]: WARNING cinder.quota [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1599546814 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1599546814, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:44:22 devstack cinder-volume[82736]: WARNING cinder.quota [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1599546814 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1599546814, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Created reservations ['ad865f23-fdfd-4e00-a72f-fb26d2c05137', 'b2671119-8d36-4846-b89e-6265d0c19df8', '3ce2da42-a759-47c6-9362-33858ffbd9f4', '728f6df9-bf19-4c5a-9ed7-2ff841302f45'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:22 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:22 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Created reservations ['eabfc3ac-e517-4278-9645-fa3497d9cacf', 'aec6f756-8e8a-4686-a818-2c1505381418', '83db5e96-2557-440a-b606-535d609b5679', '267c25a5-3b22-4384-a2db-9a80d429730c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:22 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07745f08-b3e6-41e6-9f76-634b03ee9d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:44:22 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:44:22 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[859634e2-6f14-48ef-9188-833879e89142]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:22 devstack sudo[85499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 Apr 13 17:44:22 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:22 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 0 in 0.526s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:22 devstack sudo[85504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:22 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:22 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.431s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:44:22 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c9b876c8-091b-48b2-9f3c-43fbee3cc0e7 tempest-GroupsTest-2123514569 None] Delete group completed successfully. Apr 13 17:44:22 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76" returned: 0 in 0.612s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:22 devstack sudo[85509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 Apr 13 17:44:22 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:23 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 1 in 0.548s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.103s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea', 'name': 'volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30ed63a7-2c88-4c40-bad4-5a482586990d', 'enforce_multipath': True} {{(pid=82736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 17:44:23 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-540ca83c-9825-404c-b86d-0711847a2655 req-79bb9a5f-41f5-46a4-98c5-3c88c50f60d4 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] attachment_update completed successfully. Apr 13 17:44:23 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123" returned: 0 in 0.557s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:23 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123 Apr 13 17:44:23 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:23 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76.5f7d042d-4112-40a7-980c-88e76007f123" returned: 0 in 0.441s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-quobyte-5f7d042d-4112-40a7-980c-88e76007f123" released by "_delete_snapshot" :: held 2.180s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-quobyte-07745f08-b3e6-41e6-9f76-634b03ee9d76" released by "delete_snapshot" :: held 2.192s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:23 devstack cinder-volume[82736]: WARNING cinder.quota [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:44:23 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Created reservations ['fa05dbd3-c8e1-4ade-b9dd-ba9f2e07e646', 'abef6c70-6cda-4951-ae86-eb4f81e813df', 'f0dc7359-bda8-4141-a905-8026eec9314e', '2a21ab7c-e735-41cb-b4da-d4a2a3b078d8'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:24 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Delete snapshot completed successfully. Apr 13 17:44:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-84ae89a6-b27d-4eb3-84fb-4898f69bffd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-5f7d042d-4112-40a7-980c-88e76007f123-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "cinder-07745f08-b3e6-41e6-9f76-634b03ee9d76-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-07745f08-b3e6-41e6-9f76-634b03ee9d76-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "cinder-quobyte-07745f08-b3e6-41e6-9f76-634b03ee9d76" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-quobyte-07745f08-b3e6-41e6-9f76-634b03ee9d76" acquired by "delete_volume" :: waited 0.025s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:25 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bbf616-ca23-4553-8c40-e0312efc9e55]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:25 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 Apr 13 17:44:25 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:25 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76" returned: 0 in 0.656s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:25 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76 Apr 13 17:44:25 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:26 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-07745f08-b3e6-41e6-9f76-634b03ee9d76" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-quobyte-07745f08-b3e6-41e6-9f76-634b03ee9d76" released by "delete_volume" :: held 1.201s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Created reservations ['af94efaf-d737-448d-9132-4d4c4971acbc', 'f5ecf59c-b8de-418a-9d16-f3a5c8043ac6', '11321ab3-76b9-4e97-b31a-6926d3831a5c', '6850ed99-1a8d-40ce-8978-19f3a7672456'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=109,cinder:UPDATE=108,cinder:INSERT=23,cinder:DELETE=5 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:26 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:44:26 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d8dc42bd-742a-4cc7-a684-95daa4287277 tempest-GroupsV314Test-84703437 None] Group tempest-GroupsV314Test-Group-1017546883: creating Apr 13 17:44:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d8dc42bd-742a-4cc7-a684-95daa4287277 tempest-GroupsV314Test-84703437 None] Group tempest-GroupsV314Test-Group-1017546883: created successfully Apr 13 17:44:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d8dc42bd-742a-4cc7-a684-95daa4287277 tempest-GroupsV314Test-84703437 None] Create group completed successfully. Apr 13 17:44:26 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.505s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:44:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Deleted volume successfully. Apr 13 17:44:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-17265c12-6e72-4da7-b36a-c554b894430b tempest-VolumeSnapshotQuotasNegativeTestJSON-1980593376 None] Lock "cinder-07745f08-b3e6-41e6-9f76-634b03ee9d76-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Flow 'volume_create_manager' (08afc962-3d50-49a6-8d5b-4c06cf714f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cefa66d-3e2f-46f6-836d-32429db61e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cefa66d-3e2f-46f6-836d-32429db61e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-802462006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f023a5b1-591b-48f6-b94f-b1714d4f2fc8,host='devstack@QuobyteHD#QuobyteHD',id=75675687-c373-4b72-ada7-a3221558c658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c652fbbdbc41c98c7f1f9b1c2c7a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:29Z,use_quota=True,user_id='7e4f5cd89b154e8b8954b9344b360181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eada207-b81a-4174-965e-5692cf057efc),volume_type_id=7eada207-b81a-4174-965e-5692cf057efc)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c67584-4131-4237-ae3d-2e10373882c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c67584-4131-4237-ae3d-2e10373882c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71397c34-26e3-4122-85f6-15033e741422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71397c34-26e3-4122-85f6-15033e741422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75675687-c373-4b72-ada7-a3221558c658', 'volume_name': 'volume-75675687-c373-4b72-ada7-a3221558c658', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f55c0e2-79b5-4055-a211-e75e470c5bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f55c0e2-79b5-4055-a211-e75e470c5bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ffea0a-d22b-4686-86fa-f903e030d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:28 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Volume 75675687-c373-4b72-ada7-a3221558c658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75675687-c373-4b72-ada7-a3221558c658', 'volume_size': 1} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f023a5b1-591b-48f6-b94f-b1714d4f2fc8,created_at=2026-04-13T15:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-802462006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f023a5b1-591b-48f6-b94f-b1714d4f2fc8,host='devstack@QuobyteHD#QuobyteHD',id=75675687-c373-4b72-ada7-a3221558c658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c652fbbdbc41c98c7f1f9b1c2c7a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:29Z,use_quota=True,user_id='7e4f5cd89b154e8b8954b9344b360181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eada207-b81a-4174-965e-5692cf057efc),volume_type_id=7eada207-b81a-4174-965e-5692cf057efc)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Creating volume 75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:28 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:29 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 1073741824 Apr 13 17:44:29 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:29 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 1073741824" returned: 0 in 0.939s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:29 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 Apr 13 17:44:29 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:30 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658" returned: 0 in 0.583s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ffea0a-d22b-4686-86fa-f903e030d783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75675687-c373-4b72-ada7-a3221558c658', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4a1e2d-43c5-4811-891b-673d1a73316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:30 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Volume volume-75675687-c373-4b72-ada7-a3221558c658 (75675687-c373-4b72-ada7-a3221558c658): created successfully Apr 13 17:44:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4a1e2d-43c5-4811-891b-673d1a73316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Flow 'volume_create_manager' (08afc962-3d50-49a6-8d5b-4c06cf714f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:30 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1bcaaa0f-a1cc-4efc-8744-6005806323aa tempest-GroupsV314Test-84703437 None] Created volume successfully. Apr 13 17:44:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:31 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Cloning volume 75675687-c373-4b72-ada7-a3221558c658 to volume 980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 Apr 13 17:44:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Creating offline snapshot 1848bd1c-c0f8-43fc-8f59-58aa62a67003 of volume 75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:44:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a23f03-88b4-48a7-8f23-bfa61b5ab0c8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:32 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 Apr 13 17:44:32 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:33 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658" returned: 0 in 1.026s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:33 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 1G Apr 13 17:44:33 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:33 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 1G" returned: 0 in 0.872s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75675687-c373-4b72-ada7-a3221558c658 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:33 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75675687-c373-4b72-ada7-a3221558c658 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 Apr 13 17:44:33 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:34 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75675687-c373-4b72-ada7-a3221558c658 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003" returned: 0 in 0.615s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:34 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:44:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:34 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 Apr 13 17:44:34 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:35 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003" returned: 0 in 0.935s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:UPDATE=155,cinder:SELECT=131,cinder:DELETE=12,cinder:INSERT=46 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:35 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.info Apr 13 17:44:35 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Flow 'volume_create_manager' (aa3cb760-94bc-4505-b501-9b0f6a35a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a2c7ad-4f28-4ae4-8154-95cf4b828b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a2c7ad-4f28-4ae4-8154-95cf4b828b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1534436677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771c367a-9323-45b9-a461-c01806b37fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81db101f9f6e443abe423b9b9f7c029a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:36Z,use_quota=True,user_id='25f34581881e4c46bd21e35a6dbebbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf9167b-b96c-45b1-8c4e-18f797f19aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf9167b-b96c-45b1-8c4e-18f797f19aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238bc498-e7ea-4a32-ad98-72ee07e5439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238bc498-e7ea-4a32-ad98-72ee07e5439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771c367a-9323-45b9-a461-c01806b37fb0', 'volume_name': 'volume-771c367a-9323-45b9-a461-c01806b37fb0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc885b4-f4cd-4d5c-bf3c-7dd1ec00313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc885b4-f4cd-4d5c-bf3c-7dd1ec00313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22e095e-2c30-491f-967b-27f1a41b75cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:35 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Volume 771c367a-9323-45b9-a461-c01806b37fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771c367a-9323-45b9-a461-c01806b37fb0', 'volume_size': 1} Apr 13 17:44:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:36 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.info" returned: 0 in 0.612s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:36 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:36 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.info Apr 13 17:44:36 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:36 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.info" returned: 0 in 0.562s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Acquiring lock "cinder-quobyte-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Lock "cinder-quobyte-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] snapshot: 1848bd1c-c0f8-43fc-8f59-58aa62a67003, volume: 980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[200774e0-ecc9-40cf-9c4c-25e8d7827ef1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:36 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 Apr 13 17:44:36 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:37 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003" returned: 0 in 0.678s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75675687-c373-4b72-ada7-a3221558c658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:44:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:44:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:44:37 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c60897-c5de-4670-a99a-bd20a330c016]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:37 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 Apr 13 17:44:37 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:37 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658" returned: 0 in 0.563s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:38 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:44:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:38 devstack sudo[85744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 Apr 13 17:44:38 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:41 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" returned: 0 in 3.580s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:41 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a2c18b-e111-4add-a9c8-7f14dd0afff2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:41 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 Apr 13 17:44:41 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:42 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658" returned: 0 in 1.212s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:42 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658, size 1024.00 MB, duration 3.58 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:44:42 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Converted 1024.00 MB image at 285.97 MB/s Apr 13 17:44:42 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:44:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:42 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 Apr 13 17:44:42 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:43 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" returned: 0 in 0.687s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Lock "cinder-quobyte-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" released by "_copy_volume_from_snapshot" :: held 6.808s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Acquiring lock "cinder-quobyte-1848bd1c-c0f8-43fc-8f59-58aa62a67003" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Lock "cinder-quobyte-1848bd1c-c0f8-43fc-8f59-58aa62a67003" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Deleting offline snapshot 1848bd1c-c0f8-43fc-8f59-58aa62a67003 of volume 75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] snapshot_file for this snap is: volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873f754-117a-4ae2-b5d9-c7a4bf26fc24]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Flow 'volume_create_manager' (fb490e42-b4a3-47ba-a8e5-7e82632a6655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085d8726-59d6-434c-8a89-851100433ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085d8726-59d6-434c-8a89-851100433ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1472506964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a819067-861f-4829-913d-a0358800b6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16ffa496e44458ba9b273d36172b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:44Z,use_quota=True,user_id='0e4053b4cdc34f38b0a3f059b48d178f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8857b18-0859-414c-b8fe-8ed8f4167a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:43 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8857b18-0859-414c-b8fe-8ed8f4167a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:43 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48747084-75f3-48a9-b0ad-ceb6607bff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48747084-75f3-48a9-b0ad-ceb6607bff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a819067-861f-4829-913d-a0358800b6ef', 'volume_name': 'volume-5a819067-861f-4829-913d-a0358800b6ef', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41a844a-66b6-40e1-9bbd-43ab95ed29a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41a844a-66b6-40e1-9bbd-43ab95ed29a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ea2949-3f7c-450e-9d75-1885289843fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:43 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Volume 5a819067-861f-4829-913d-a0358800b6ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a819067-861f-4829-913d-a0358800b6ef', 'volume_size': 1} Apr 13 17:44:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:44 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003" returned: 0 in 0.604s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75675687-c373-4b72-ada7-a3221558c658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:44:44 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fdd48b-8920-4003-b334-e2b63216fdd4]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:44 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 Apr 13 17:44:44 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:44 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658" returned: 0 in 0.534s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:44 devstack sudo[85847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 Apr 13 17:44:44 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:45 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003" returned: 0 in 0.471s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:45 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003 Apr 13 17:44:45 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:45 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658.1848bd1c-c0f8-43fc-8f59-58aa62a67003" returned: 0 in 0.438s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Lock "cinder-quobyte-1848bd1c-c0f8-43fc-8f59-58aa62a67003" released by "_delete_snapshot" :: held 2.158s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.971s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.779s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1534436677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771c367a-9323-45b9-a461-c01806b37fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81db101f9f6e443abe423b9b9f7c029a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:36Z,use_quota=True,user_id='25f34581881e4c46bd21e35a6dbebbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Creating volume 771c367a-9323-45b9-a461-c01806b37fb0 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:45 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:45 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 1073741824 Apr 13 17:44:45 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:45 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ddf77462-a422-4738-86f0-ed22b41c204d tempest-GroupsV314Test-84703437 None] Create group from source-group-f023a5b1-591b-48f6-b94f-b1714d4f2fc8 completed successfully. Apr 13 17:44:46 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 1073741824" returned: 0 in 0.822s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:46 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 Apr 13 17:44:46 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Acquiring lock "cinder-quobyte-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Lock "cinder-quobyte-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" acquired by "delete_volume" :: waited 0.024s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d6745e-b463-43b5-9751-6315f218f76f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:47 devstack sudo[85910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 Apr 13 17:44:47 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:47 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0" returned: 0 in 0.804s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.582s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1472506964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a819067-861f-4829-913d-a0358800b6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16ffa496e44458ba9b273d36172b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:44Z,use_quota=True,user_id='0e4053b4cdc34f38b0a3f059b48d178f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Creating volume 5a819067-861f-4829-913d-a0358800b6ef {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:47 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22e095e-2c30-491f-967b-27f1a41b75cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771c367a-9323-45b9-a461-c01806b37fb0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:47 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef 1073741824 Apr 13 17:44:47 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709badf3-833b-4f4a-ab82-9b363d82bba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:47 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Volume volume-771c367a-9323-45b9-a461-c01806b37fb0 (771c367a-9323-45b9-a461-c01806b37fb0): created successfully Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709badf3-833b-4f4a-ab82-9b363d82bba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Flow 'volume_create_manager' (aa3cb760-94bc-4505-b501-9b0f6a35a731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:47 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-594b71b0-eced-4f6d-a44c-bd47238c8265 tempest-DeleteServersTestJSON-296117833 None] Created volume successfully. Apr 13 17:44:48 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" returned: 0 in 1.197s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:48 devstack sudo[85925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59 Apr 13 17:44:48 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:48 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef 1073741824" returned: 0 in 1.264s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:48 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef Apr 13 17:44:48 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:48 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Lock "cinder-quobyte-980b0b61-a40e-4c7f-bf57-a2a3bb6b9a59" released by "delete_volume" :: held 1.778s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Created reservations ['9a5cd376-d8d4-4663-88ea-cd2635fb4c4d'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:48 devstack cinder-volume[82736]: WARNING cinder.quota [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-931913863 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-931913863, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:44:48 devstack cinder-volume[82736]: WARNING cinder.quota [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-931913863 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-931913863, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Created reservations ['7fe7a156-b741-4b43-bc9e-bfbd090750e1', '62bcbe40-4f58-4561-b92f-1020d7da486e', '2bb0d28c-b490-4270-86dd-1c1dfe437b58', 'd108593d-49b0-4872-a099-47a5216dc598'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:48 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:44:49 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:49 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef" returned: 0 in 0.579s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ea2949-3f7c-450e-9d75-1885289843fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a819067-861f-4829-913d-a0358800b6ef', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a568e8c4-641f-4bba-aa3a-2e2c332d57aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:49 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Volume volume-5a819067-861f-4829-913d-a0358800b6ef (5a819067-861f-4829-913d-a0358800b6ef): created successfully Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a568e8c4-641f-4bba-aa3a-2e2c332d57aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Flow 'volume_create_manager' (fb490e42-b4a3-47ba-a8e5-7e82632a6655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:49 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-83e12bd1-4c1c-4d6a-8e8c-5d07475f67da tempest-VolumesListAdminTestJSON-1972293897 None] Created volume successfully. Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Acquiring lock "cinder-quobyte-75675687-c373-4b72-ada7-a3221558c658" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Lock "cinder-quobyte-75675687-c373-4b72-ada7-a3221558c658" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca77b8a4-61ad-4552-96c9-b6e96e68f507]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:49 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.739s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:49 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:44:49 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ad66d077-c2af-49fd-935c-cee452efc679 tempest-GroupsV314Test-84703437 None] Delete group completed successfully. Apr 13 17:44:49 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 Apr 13 17:44:49 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:50 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658" returned: 0 in 0.506s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:50 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658 Apr 13 17:44:50 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:50 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-75675687-c373-4b72-ada7-a3221558c658" returned: 0 in 0.569s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Lock "cinder-quobyte-75675687-c373-4b72-ada7-a3221558c658" released by "delete_volume" :: held 1.170s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Created reservations ['9b3b6483-0b45-43cf-a041-11b8a1aa79c0'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Flow 'volume_create_manager' (05267600-87dc-493d-b8a7-4c2040aeba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6359cbb-b14a-4f57-8356-5118e9a4ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6359cbb-b14a-4f57-8356-5118e9a4ec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1880261927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651229d0-a4d0-4853-9391-adfe4c05d55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16ffa496e44458ba9b273d36172b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:51Z,use_quota=True,user_id='0e4053b4cdc34f38b0a3f059b48d178f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396a65ce-775e-41ee-9435-3a256cd6cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396a65ce-775e-41ee-9435-3a256cd6cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b518e35-bf85-498f-9ae0-0cc879c5861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b518e35-bf85-498f-9ae0-0cc879c5861d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651229d0-a4d0-4853-9391-adfe4c05d55a', 'volume_name': 'volume-651229d0-a4d0-4853-9391-adfe4c05d55a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76f7750-ccf8-4cec-b696-b1c844f0d7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76f7750-ccf8-4cec-b696-b1c844f0d7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f960c42-00c2-4bc0-a8bb-808d3a1a7704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:50 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Volume 651229d0-a4d0-4853-9391-adfe4c05d55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651229d0-a4d0-4853-9391-adfe4c05d55a', 'volume_size': 1} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1880261927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651229d0-a4d0-4853-9391-adfe4c05d55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16ffa496e44458ba9b273d36172b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:51Z,use_quota=True,user_id='0e4053b4cdc34f38b0a3f059b48d178f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Creating volume 651229d0-a4d0-4853-9391-adfe4c05d55a {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:50 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:50 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Created reservations ['396b8f6e-9174-4171-b454-439f933877b1', '5eb62e21-e6f3-4b63-a163-7a299f923553', 'af0577c7-de42-417a-8eeb-595050d14df3', '1d1e8a01-9352-41c1-a85a-78459ca45b29'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:50 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a 1073741824 Apr 13 17:44:50 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:51 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:44:51 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-c0d857c7-be9a-472b-9170-7fe970a51386 req-b7afcff4-4420-4b8c-955b-45b50a26f37e tempest-DeleteServersTestJSON-296117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:51 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a 1073741824" returned: 0 in 0.638s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:51 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a Apr 13 17:44:51 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:51 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.635s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:51 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:44:51 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6e797136-fa27-41c9-b52e-c34ed4c8f519 tempest-GroupsV314Test-84703437 None] Delete group completed successfully. Apr 13 17:44:52 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-c0d857c7-be9a-472b-9170-7fe970a51386 req-b7afcff4-4420-4b8c-955b-45b50a26f37e tempest-DeleteServersTestJSON-296117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.582s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f960c42-00c2-4bc0-a8bb-808d3a1a7704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651229d0-a4d0-4853-9391-adfe4c05d55a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fed78a7-3f74-4a8e-a01f-bef71a49ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db174f1-e0d5-47c5-871c-5858acb3743f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-c0d857c7-be9a-472b-9170-7fe970a51386 req-b7afcff4-4420-4b8c-955b-45b50a26f37e tempest-DeleteServersTestJSON-296117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:52 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Volume volume-651229d0-a4d0-4853-9391-adfe4c05d55a (651229d0-a4d0-4853-9391-adfe4c05d55a): created successfully Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fed78a7-3f74-4a8e-a01f-bef71a49ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Flow 'volume_create_manager' (05267600-87dc-493d-b8a7-4c2040aeba30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:52 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-75de0ee4-4880-42a1-bbd1-734f00c8b826 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Terminate volume connection completed successfully. Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-75de0ee4-4880-42a1-bbd1-734f00c8b826 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Deleting attachment 30ed63a7-2c88-4c40-bad4-5a482586990d. {{(pid=82736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 17:44:52 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-57e4e339-b572-4df6-8776-16a8e36a2213 tempest-VolumesListAdminTestJSON-1972293897 None] Created volume successfully. Apr 13 17:44:52 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 Apr 13 17:44:52 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:52 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-c0d857c7-be9a-472b-9170-7fe970a51386 req-b7afcff4-4420-4b8c-955b-45b50a26f37e tempest-DeleteServersTestJSON-296117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0" returned: 0 in 0.652s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-c0d857c7-be9a-472b-9170-7fe970a51386 req-b7afcff4-4420-4b8c-955b-45b50a26f37e tempest-DeleteServersTestJSON-296117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.685s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-c0d857c7-be9a-472b-9170-7fe970a51386 req-b7afcff4-4420-4b8c-955b-45b50a26f37e tempest-DeleteServersTestJSON-296117833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea', 'name': 'volume-771c367a-9323-45b9-a461-c01806b37fb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45660451-cbc3-4105-947b-cfbb11091100', 'enforce_multipath': True} {{(pid=82736) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 17:44:52 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-c0d857c7-be9a-472b-9170-7fe970a51386 req-b7afcff4-4420-4b8c-955b-45b50a26f37e tempest-DeleteServersTestJSON-296117833 None] attachment_update completed successfully. Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "cinder-c2ab7068-c47c-4d7b-9751-9b4464b2de43-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "cinder-c2ab7068-c47c-4d7b-9751-9b4464b2de43-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "cinder-quobyte-c2ab7068-c47c-4d7b-9751-9b4464b2de43" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "cinder-quobyte-c2ab7068-c47c-4d7b-9751-9b4464b2de43" acquired by "delete_volume" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3f87f3-4808-4889-8abb-b85169c2bc53]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:53 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:53 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Flow 'volume_create_manager' (4056af33-ccdf-467c-a336-58349aae22db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e69983-813a-4116-9c2a-1d95717dd8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e69983-813a-4116-9c2a-1d95717dd8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-564399735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f452f971-66b8-4701-bdc2-9fea24ef036e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16ffa496e44458ba9b273d36172b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:53Z,use_quota=True,user_id='0e4053b4cdc34f38b0a3f059b48d178f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d35fc3-9b5e-4f73-b1f6-c9d6e94867c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d35fc3-9b5e-4f73-b1f6-c9d6e94867c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82531f0e-83b3-4215-bd80-2ecb254da66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82531f0e-83b3-4215-bd80-2ecb254da66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f452f971-66b8-4701-bdc2-9fea24ef036e', 'volume_name': 'volume-f452f971-66b8-4701-bdc2-9fea24ef036e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed951205-f9d7-43a7-9883-3beea8d3e339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed951205-f9d7-43a7-9883-3beea8d3e339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033a83eb-9d2f-4308-a795-97b7bf3026a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:53 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Volume f452f971-66b8-4701-bdc2-9fea24ef036e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f452f971-66b8-4701-bdc2-9fea24ef036e', 'volume_size': 1} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-564399735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f452f971-66b8-4701-bdc2-9fea24ef036e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16ffa496e44458ba9b273d36172b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:53Z,use_quota=True,user_id='0e4053b4cdc34f38b0a3f059b48d178f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Creating volume f452f971-66b8-4701-bdc2-9fea24ef036e {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:53 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:53 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e 1073741824 Apr 13 17:44:53 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:53 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 0 in 0.846s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:53 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:53 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:54 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e 1073741824" returned: 0 in 0.613s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:54 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e Apr 13 17:44:54 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:54 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 1 in 0.688s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:54 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43 Apr 13 17:44:54 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:54 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e" returned: 0 in 0.604s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033a83eb-9d2f-4308-a795-97b7bf3026a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f452f971-66b8-4701-bdc2-9fea24ef036e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37334357-d105-4fc4-b0e0-88764c4fe981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:54 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Volume volume-f452f971-66b8-4701-bdc2-9fea24ef036e (f452f971-66b8-4701-bdc2-9fea24ef036e): created successfully Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37334357-d105-4fc4-b0e0-88764c4fe981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Flow 'volume_create_manager' (4056af33-ccdf-467c-a336-58349aae22db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:54 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2ab7068-c47c-4d7b-9751-9b4464b2de43" returned: 0 in 0.498s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:54 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d00794f3-ca40-46a4-a01b-f26da094276f tempest-VolumesListAdminTestJSON-1972293897 None] Created volume successfully. Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "cinder-quobyte-c2ab7068-c47c-4d7b-9751-9b4464b2de43" released by "delete_volume" :: held 2.084s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.quota [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Created reservations ['e3b5e71c-d640-45ef-bd3f-37cc405c201f', 'e3912e3c-ec63-44c0-a59a-f760ce931073', '7e24e37a-2278-40c9-a0d4-742a99f1852e', 'e6714a6f-7050-4c53-8755-d30a691a8fa2'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:55 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:44:55 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:55 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.544s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.manager [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:44:55 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Deleted volume successfully. Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-f1af9d70-826e-451c-ab66-dc96f50065cd req-4f7eba9f-e71c-44b7-ba74-e4a924a90fe9 tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "cinder-c2ab7068-c47c-4d7b-9751-9b4464b2de43-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Flow 'volume_create_manager' (5ea9cdb1-5db3-4405-8cb4-7c1a0871ff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a72400-ff68-475e-b0d7-db368de21b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a72400-ff68-475e-b0d7-db368de21b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-838504972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc360b7-f83d-44b1-916c-c0dc9326fbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fcc6371d00a4243a06395f5b9ec83be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:56Z,use_quota=True,user_id='5de88819b7b449918016e449b9ef4a12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8589ab94-4d4b-49e2-b6e0-8b72f73a66ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8589ab94-4d4b-49e2-b6e0-8b72f73a66ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc40a24-d714-48d6-95d7-f82c0adc587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc40a24-d714-48d6-95d7-f82c0adc587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc360b7-f83d-44b1-916c-c0dc9326fbd4', 'volume_name': 'volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2841c4d9-8bde-4b01-af30-b2a8f6a63c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2841c4d9-8bde-4b01-af30-b2a8f6a63c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cae44b2-f16a-4060-8407-7fc79e6a8bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:56 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Volume dfc360b7-f83d-44b1-916c-c0dc9326fbd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4', 'volume_size': 1} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-838504972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc360b7-f83d-44b1-916c-c0dc9326fbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fcc6371d00a4243a06395f5b9ec83be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:56Z,use_quota=True,user_id='5de88819b7b449918016e449b9ef4a12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Creating volume dfc360b7-f83d-44b1-916c-c0dc9326fbd4 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:56 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:56 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 1073741824 Apr 13 17:44:56 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Flow 'volume_create_manager' (8c7466e1-a4f5-4e6b-a0bc-8dd56e386d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b09bae-59bb-4b27-bf56-47d8c24742ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b09bae-59bb-4b27-bf56-47d8c24742ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e73ca0-e32d-438a-b2b9-dff6712dffe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3891a5f269c44cb19e8a852183c23238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:56Z,use_quota=True,user_id='4674362a57d24858ac9a4b2e0f98d903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ad757b-e9a1-417c-87d1-fe6ad142d9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ad757b-e9a1-417c-87d1-fe6ad142d9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f12af83-0d04-45f7-8fc7-ae1f5a495ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f12af83-0d04-45f7-8fc7-ae1f5a495ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e73ca0-e32d-438a-b2b9-dff6712dffe7', 'volume_name': 'volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aebc994-0ad0-48ad-a361-c77c37a33601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aebc994-0ad0-48ad-a361-c77c37a33601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531bc5a6-487e-42da-a614-d83573d02571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:56 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Volume c2e73ca0-e32d-438a-b2b9-dff6712dffe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7', 'volume_size': 1} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:56 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 1073741824" returned: 0 in 0.599s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:56 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 Apr 13 17:44:56 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:57 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4" returned: 0 in 0.602s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.026s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e73ca0-e32d-438a-b2b9-dff6712dffe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3891a5f269c44cb19e8a852183c23238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:44:56Z,use_quota=True,user_id='4674362a57d24858ac9a4b2e0f98d903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Creating volume c2e73ca0-e32d-438a-b2b9-dff6712dffe7 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:44:57 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cae44b2-f16a-4060-8407-7fc79e6a8bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998e218e-c712-4bba-80b9-916f1a48ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:57 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 1073741824 Apr 13 17:44:57 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:57 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Volume volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 (dfc360b7-f83d-44b1-916c-c0dc9326fbd4): created successfully Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998e218e-c712-4bba-80b9-916f1a48ace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Flow 'volume_create_manager' (5ea9cdb1-5db3-4405-8cb4-7c1a0871ff8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-0bab2a35-56b5-4131-8ea9-dbc9a4e65ea6 tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Created volume successfully. Apr 13 17:44:58 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 1073741824" returned: 0 in 0.761s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:58 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 Apr 13 17:44:58 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:58 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7" returned: 0 in 0.568s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531bc5a6-487e-42da-a614-d83573d02571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029e2932-199b-4be9-8eb0-a1f865a50c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:44:58 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Volume volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 (c2e73ca0-e32d-438a-b2b9-dff6712dffe7): created successfully Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029e2932-199b-4be9-8eb0-a1f865a50c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Flow 'volume_create_manager' (8c7466e1-a4f5-4e6b-a0bc-8dd56e386d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:44:58 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ac6c9e37-bf78-4937-ae11-ef9ae18cabc1 tempest-VolumesListAdminTestJSON-1640309078 None] Created volume successfully. Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Acquiring lock "cinder-dfc360b7-f83d-44b1-916c-c0dc9326fbd4-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "cinder-dfc360b7-f83d-44b1-916c-c0dc9326fbd4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Acquiring lock "cinder-quobyte-dfc360b7-f83d-44b1-916c-c0dc9326fbd4" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "cinder-quobyte-dfc360b7-f83d-44b1-916c-c0dc9326fbd4" acquired by "delete_volume" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[476cbd52-6c74-4e38-a4b9-a59f4452b796]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:58 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 Apr 13 17:44:58 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Acquiring lock "cinder-c2e73ca0-e32d-438a-b2b9-dff6712dffe7-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:59 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4" returned: 0 in 0.585s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Lock "cinder-c2e73ca0-e32d-438a-b2b9-dff6712dffe7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:59 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4 Apr 13 17:44:59 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Acquiring lock "cinder-quobyte-c2e73ca0-e32d-438a-b2b9-dff6712dffe7" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Lock "cinder-quobyte-c2e73ca0-e32d-438a-b2b9-dff6712dffe7" acquired by "delete_volume" :: waited 0.017s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ba126a-aabe-41a5-82bb-9c9d3308c701]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "cinder-f452f971-66b8-4701-bdc2-9fea24ef036e-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-f452f971-66b8-4701-bdc2-9fea24ef036e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "cinder-quobyte-f452f971-66b8-4701-bdc2-9fea24ef036e" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-quobyte-f452f971-66b8-4701-bdc2-9fea24ef036e" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:44:59 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 Apr 13 17:44:59 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e43127-be33-44a7-9429-926c001765f3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:44:59 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e Apr 13 17:44:59 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:44:59 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-dfc360b7-f83d-44b1-916c-c0dc9326fbd4" returned: 0 in 0.477s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "cinder-quobyte-dfc360b7-f83d-44b1-916c-c0dc9326fbd4" released by "delete_volume" :: held 1.084s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:44:59 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Created reservations ['98877418-5bcc-42c7-88eb-587a93f096b0', '9eceab49-722d-4045-8aef-aafa0d76fe30', '72b84e01-0aa3-425b-9842-55bb47f2aaf5', 'ca68ce52-8c59-4823-8172-96421b27e1b5'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:00 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:00 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:00 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7" returned: 0 in 0.598s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:00 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7 Apr 13 17:45:00 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:00 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e" returned: 0 in 0.579s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:00 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e Apr 13 17:45:00 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:00 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:00 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Deleted volume successfully. Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e290e528-54eb-452d-9631-e024192aae8b tempest-VolumeQuotasNegativeTestJSON-1990343476 None] Lock "cinder-dfc360b7-f83d-44b1-916c-c0dc9326fbd4-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:00 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c2e73ca0-e32d-438a-b2b9-dff6712dffe7" returned: 0 in 0.553s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Lock "cinder-quobyte-c2e73ca0-e32d-438a-b2b9-dff6712dffe7" released by "delete_volume" :: held 1.171s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Created reservations ['436c18f3-e5b8-4ecf-8356-25753aee57eb', 'b752476d-b756-4fa7-af71-3c660963e8f2', 'f720530c-af77-4738-8f95-2bfb93b278e7', '9e04dd06-8b1b-4fba-8ded-dccce4953675'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:00 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f452f971-66b8-4701-bdc2-9fea24ef036e" returned: 0 in 0.557s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-quobyte-f452f971-66b8-4701-bdc2-9fea24ef036e" released by "delete_volume" :: held 1.158s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:00 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:00 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Created reservations ['bc79b4a7-8431-40c7-8d31-d4fd363d54c8', '50f95452-d0c8-4e24-9c1a-19d793cf4d0c', '7614ca90-0884-4009-ad6a-0fbcbc859e74', '58bbfaf2-8976-44b2-a644-ac6e94ab3bcc'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:00 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:00 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:01 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.493s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Deleted volume successfully. Apr 13 17:45:01 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6e79a9bd-0a72-46f4-9701-f4631a064f3c tempest-VolumesListAdminTestJSON-1640309078 None] Lock "cinder-c2e73ca0-e32d-438a-b2b9-dff6712dffe7-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.434s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Deleted volume successfully. Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6196960-ab2a-46b1-bdef-8fc80dbf9c3f tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-f452f971-66b8-4701-bdc2-9fea24ef036e-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-4442027b-d69c-43a1-b799-c5fbb5ca09e4 req-62782979-1e62-49f0-9df1-49f0ec64aaef tempest-DeleteServersTestJSON-296117833 None] Terminate volume connection completed successfully. Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-4442027b-d69c-43a1-b799-c5fbb5ca09e4 req-62782979-1e62-49f0-9df1-49f0ec64aaef tempest-DeleteServersTestJSON-296117833 None] Deleting attachment 45660451-cbc3-4105-947b-cfbb11091100. {{(pid=82736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "cinder-651229d0-a4d0-4853-9391-adfe4c05d55a-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-651229d0-a4d0-4853-9391-adfe4c05d55a-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "cinder-quobyte-651229d0-a4d0-4853-9391-adfe4c05d55a" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-quobyte-651229d0-a4d0-4853-9391-adfe4c05d55a" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae7f32c-a4a8-4f71-b3da-97f2cf29d86e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:01 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a Apr 13 17:45:01 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:02 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a" returned: 0 in 0.614s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:02 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a Apr 13 17:45:02 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:02 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-651229d0-a4d0-4853-9391-adfe4c05d55a" returned: 0 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-quobyte-651229d0-a4d0-4853-9391-adfe4c05d55a" released by "delete_volume" :: held 1.193s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Created reservations ['262839d7-0dc0-4da1-90a3-ab004fd966a5', '55c5f2f9-4c3f-4229-8e0c-caf2db1e6f03', 'f5798784-7309-48f3-a812-11ee8d5090f4', '92497107-8b34-4de4-b243-c1cb0858ab9a'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:03 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:03 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:03 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.500s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:03 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Deleted volume successfully. Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-62768eca-ab21-455e-ac09-e97cd3738a2a tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-651229d0-a4d0-4853-9391-adfe4c05d55a-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "cinder-5a819067-861f-4829-913d-a0358800b6ef-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-5a819067-861f-4829-913d-a0358800b6ef-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "cinder-quobyte-5a819067-861f-4829-913d-a0358800b6ef" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-quobyte-5a819067-861f-4829-913d-a0358800b6ef" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:04 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[192732d9-796a-4eaf-bf1c-69008ca81d3a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:04 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef Apr 13 17:45:04 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:04 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef" returned: 0 in 0.655s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:04 devstack sudo[86190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef Apr 13 17:45:04 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Acquiring lock "cinder-771c367a-9323-45b9-a461-c01806b37fb0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Lock "cinder-771c367a-9323-45b9-a461-c01806b37fb0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Acquiring lock "cinder-quobyte-771c367a-9323-45b9-a461-c01806b37fb0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Lock "cinder-quobyte-771c367a-9323-45b9-a461-c01806b37fb0" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c3555b-35fa-4a3d-8bb2-11beaf440d3c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:05 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 Apr 13 17:45:05 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:05 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5a819067-861f-4829-913d-a0358800b6ef" returned: 0 in 0.592s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-quobyte-5a819067-861f-4829-913d-a0358800b6ef" released by "delete_volume" :: held 1.274s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Created reservations ['98b2a22b-6fd6-4cad-bd05-4112383bc52e', '5cdda67c-9040-4f29-a88f-1a601b5a82b8', '35bb3d97-09f0-4e8f-9f4f-93b2a5fde16c', 'cf88f76f-6acf-4a94-b5a0-852aa6075f49'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:05 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:05 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:05 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0" returned: 0 in 0.576s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:05 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0 Apr 13 17:45:05 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:05 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.462s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:05 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Deleted volume successfully. Apr 13 17:45:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c368ee1b-4e8f-4e3c-8ac2-a397f3c9ca66 tempest-VolumesListAdminTestJSON-1972293897 None] Lock "cinder-5a819067-861f-4829-913d-a0358800b6ef-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:06 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-c5ddac5c-c92c-42e5-a083-fa666ad7491d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Terminate volume connection completed successfully. Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-c5ddac5c-c92c-42e5-a083-fa666ad7491d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Deleting attachment 41f976e7-8424-4e02-ae37-6ebec15c2b94. {{(pid=82736) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 17:45:06 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-771c367a-9323-45b9-a461-c01806b37fb0" returned: 0 in 0.443s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Lock "cinder-quobyte-771c367a-9323-45b9-a461-c01806b37fb0" released by "delete_volume" :: held 1.055s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Created reservations ['a276086c-bf87-4828-9359-bdd1a37d3a00', 'c89a23bd-2da0-4874-bfbb-8e88641064ac', '1ab1aff8-9903-477b-b0d9-ebfb979bd332', '3e254bad-c5be-455e-b2fc-43633cb48d44'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:06 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:06 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "cinder-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "cinder-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:06 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:06 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Deleted volume successfully. Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "cinder-quobyte-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2249593-91eb-4672-8c20-a98419f29f83 tempest-DeleteServersTestJSON-296117833 None] Lock "cinder-771c367a-9323-45b9-a461-c01806b37fb0-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "cinder-quobyte-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f90e6c-dd60-4bde-b41f-06ebaef44a1f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:06 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f Apr 13 17:45:06 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:07 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f" returned: 0 in 0.619s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:07 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f Apr 13 17:45:07 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:08 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "cinder-quobyte-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f" released by "delete_volume" :: held 1.145s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG cinder.quota [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Created reservations ['bc7902bf-7991-40cc-9803-6a401672df15', 'aca079fd-bd5b-4167-9bd3-ea4a485dfa4c', 'c46cab11-5779-4b66-9182-76c2f3b878f8', '0962356e-34c3-4a54-812c-9ad2061de626'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:08 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:08 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:08 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.549s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG cinder.manager [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:08 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Deleted volume successfully. Apr 13 17:45:08 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-77f8935b-eafc-4e6d-a42c-cf43379256a4 req-4fa0e65a-3688-4675-9c81-856e474ba48d tempest-ServerBootFromVolumeStableRescueTest-256093244 None] Lock "cinder-224ba4fe-d450-4c04-bfdc-bdea5c9e3f0f-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:45:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:09 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:09 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:10 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:10 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Flow 'volume_create_manager' (b5d19cd7-e496-4b24-87e7-80afe22b532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6a9802-f051-47f7-8c72-a31463e7a99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6a9802-f051-47f7-8c72-a31463e7a99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-479633868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d5e537-13e7-4afe-84bf-23cb223f6b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed00ed01109940fca8d20c4b08597538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:15Z,use_quota=True,user_id='f3173f1fe10f410e8a7387b60d534b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8957e5-302f-4ad8-9282-4afc90a1bb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8957e5-302f-4ad8-9282-4afc90a1bb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de96a232-784f-4199-811b-934e17819046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de96a232-784f-4199-811b-934e17819046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d5e537-13e7-4afe-84bf-23cb223f6b3c', 'volume_name': 'volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c507c7ea-76da-452e-af60-29be5be90f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c507c7ea-76da-452e-af60-29be5be90f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f6e300-68aa-4021-abe7-170f0364cc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Volume c5d5e537-13e7-4afe-84bf-23cb223f6b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c', 'volume_size': 1} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-479633868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d5e537-13e7-4afe-84bf-23cb223f6b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed00ed01109940fca8d20c4b08597538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:15Z,use_quota=True,user_id='f3173f1fe10f410e8a7387b60d534b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Creating volume c5d5e537-13e7-4afe-84bf-23cb223f6b3c {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:15 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:15 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c 1073741824 Apr 13 17:45:15 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:15 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c 1073741824" returned: 0 in 0.607s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:15 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c Apr 13 17:45:15 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:16 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c" returned: 0 in 0.511s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f6e300-68aa-4021-abe7-170f0364cc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d96b3a-1b30-408d-88ab-d26330951ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Volume volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c (c5d5e537-13e7-4afe-84bf-23cb223f6b3c): created successfully Apr 13 17:45:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d96b3a-1b30-408d-88ab-d26330951ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Flow 'volume_create_manager' (b5d19cd7-e496-4b24-87e7-80afe22b532a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:16 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a377b231-ab5b-413b-be44-6f985bf9c77d tempest-AbsoluteLimitsTests-407692530 None] Created volume successfully. Apr 13 17:45:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-0034613e-d242-461a-8689-5ffb8d2f96d7 tempest-GroupSnapshotsV319Test-1243899573 None] Group tempest-GroupSnapshotsV319Test-Group-1547242483: creating Apr 13 17:45:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-0034613e-d242-461a-8689-5ffb8d2f96d7 tempest-GroupSnapshotsV319Test-1243899573 None] Group tempest-GroupSnapshotsV319Test-Group-1547242483: created successfully Apr 13 17:45:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-0034613e-d242-461a-8689-5ffb8d2f96d7 tempest-GroupSnapshotsV319Test-1243899573 None] Create group completed successfully. Apr 13 17:45:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Acquiring lock "cinder-c5d5e537-13e7-4afe-84bf-23cb223f6b3c-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Lock "cinder-c5d5e537-13e7-4afe-84bf-23cb223f6b3c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Acquiring lock "cinder-quobyte-c5d5e537-13e7-4afe-84bf-23cb223f6b3c" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Lock "cinder-quobyte-c5d5e537-13e7-4afe-84bf-23cb223f6b3c" acquired by "delete_volume" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:17 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cee3d9-b759-4f8a-a909-4a678181b2de]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:17 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c Apr 13 17:45:17 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:18 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c" returned: 0 in 0.627s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:18 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c Apr 13 17:45:18 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:18 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c5d5e537-13e7-4afe-84bf-23cb223f6b3c" returned: 0 in 0.528s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Lock "cinder-quobyte-c5d5e537-13e7-4afe-84bf-23cb223f6b3c" released by "delete_volume" :: held 1.195s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Created reservations ['51877e4e-dc89-4cf8-95ed-1d04b8b29eef', '1cd6e2ab-a323-4c3c-90e8-f91842029268', '36bf3a48-811a-4775-be53-fdc2bac81b84', '62c3847f-92fe-4ea4-8037-cb6e8c95217e'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:18 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:18 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Flow 'volume_create_manager' (474b648b-170a-4e37-a4ba-af73e8a4d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4955f381-6ed2-4b4f-85b4-d665086650e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4955f381-6ed2-4b4f-85b4-d665086650e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-408024095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4bfe09d3-f061-4b87-a8bb-a036f68a3b19,host='devstack@QuobyteHD#QuobyteHD',id=734d396f-4cc2-490e-945b-0553e8213665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fc783b11d7480290deab90fa17c9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:19Z,use_quota=True,user_id='545f48326a204bdd9b5df4aefb3033c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa64e7b6-ca0a-494e-8f5f-1efcba3efc1f),volume_type_id=fa64e7b6-ca0a-494e-8f5f-1efcba3efc1f)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8986a8d7-a83d-4687-b4c7-bfbb400f6f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8986a8d7-a83d-4687-b4c7-bfbb400f6f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751f28dd-7f12-45a5-89b6-6fb4fc3e1a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751f28dd-7f12-45a5-89b6-6fb4fc3e1a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734d396f-4cc2-490e-945b-0553e8213665', 'volume_name': 'volume-734d396f-4cc2-490e-945b-0553e8213665', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da09ff03-3b98-42ea-89f5-4a5354593a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da09ff03-3b98-42ea-89f5-4a5354593a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9458688-6233-44b5-8b71-4ea8a0b95eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:19 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Volume 734d396f-4cc2-490e-945b-0553e8213665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734d396f-4cc2-490e-945b-0553e8213665', 'volume_size': 1} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4bfe09d3-f061-4b87-a8bb-a036f68a3b19,created_at=2026-04-13T15:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-408024095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4bfe09d3-f061-4b87-a8bb-a036f68a3b19,host='devstack@QuobyteHD#QuobyteHD',id=734d396f-4cc2-490e-945b-0553e8213665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fc783b11d7480290deab90fa17c9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:19Z,use_quota=True,user_id='545f48326a204bdd9b5df4aefb3033c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa64e7b6-ca0a-494e-8f5f-1efcba3efc1f),volume_type_id=fa64e7b6-ca0a-494e-8f5f-1efcba3efc1f)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Creating volume 734d396f-4cc2-490e-945b-0553e8213665 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:19 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:19 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 1073741824 Apr 13 17:45:19 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:19 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.673s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:19 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Deleted volume successfully. Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-27f63895-a127-4d1c-9cb8-7686c95e1d81 tempest-AbsoluteLimitsTests-407692530 None] Lock "cinder-c5d5e537-13e7-4afe-84bf-23cb223f6b3c-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:19 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 1073741824" returned: 0 in 0.658s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:19 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 Apr 13 17:45:19 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:20 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665" returned: 0 in 0.631s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9458688-6233-44b5-8b71-4ea8a0b95eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734d396f-4cc2-490e-945b-0553e8213665', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f3e991-7525-4db2-a3a8-4a5244a720a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:20 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Volume volume-734d396f-4cc2-490e-945b-0553e8213665 (734d396f-4cc2-490e-945b-0553e8213665): created successfully Apr 13 17:45:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f3e991-7525-4db2-a3a8-4a5244a720a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Flow 'volume_create_manager' (474b648b-170a-4e37-a4ba-af73e8a4d716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:20 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-fc9069e4-414f-4922-a83f-fc2349f6b3e4 tempest-GroupSnapshotsV319Test-1243899573 None] Created volume successfully. Apr 13 17:45:21 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] GroupSnapshot 81398cee-5370-40e5-8449-dba281eeb293: creating. Apr 13 17:45:21 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Group snapshot 81398cee-5370-40e5-8449-dba281eeb293: creating. {{(pid=82736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 17:45:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.014s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Creating offline snapshot 8c12b892-9592-4cb4-a807-dd28d8e8e374 of volume 734d396f-4cc2-490e-945b-0553e8213665 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:45:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3219775b-7a7f-4714-8840-9095a3a23b97]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:21 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 Apr 13 17:45:21 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:22 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665" returned: 0 in 0.680s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:22 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 1G Apr 13 17:45:22 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:22 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 1G" returned: 0 in 0.706s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734d396f-4cc2-490e-945b-0553e8213665 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:22 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734d396f-4cc2-490e-945b-0553e8213665 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 Apr 13 17:45:22 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:23 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-734d396f-4cc2-490e-945b-0553e8213665 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374" returned: 0 in 0.639s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:23 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:23 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 Apr 13 17:45:23 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (e702db12-c5ff-441f-b1c8-013335dbb097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df843d80-4655-48e7-b2be-06a5acb33595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df843d80-4655-48e7-b2be-06a5acb33595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1041666733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757ba7a0-81de-4cf0-8eab-36923ad48cf0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:24Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47aa2dc7-98ed-486a-b10a-a264a7667261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47aa2dc7-98ed-486a-b10a-a264a7667261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fbabb1-9e6c-46d3-8680-2ac5ce088d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fbabb1-9e6c-46d3-8680-2ac5ce088d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757ba7a0-81de-4cf0-8eab-36923ad48cf0', 'volume_name': 'volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da1123c-d26e-45f0-9e43-7e43eede2e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da1123c-d26e-45f0-9e43-7e43eede2e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b5d55c-38d2-47c1-9e18-643e19f90544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:23 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Volume 757ba7a0-81de-4cf0-8eab-36923ad48cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0', 'volume_size': 1} Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:23 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374" returned: 0 in 0.615s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:24 devstack sudo[86316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.info Apr 13 17:45:24 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:24 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.info" returned: 0 in 0.436s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:24 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:24 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.info Apr 13 17:45:24 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Flow 'volume_create_manager' (bd84b128-8309-4afb-a104-e54ecd0092c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e280cb-c60b-499d-b32f-6473d608c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e280cb-c60b-499d-b32f-6473d608c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-867219492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece6412e-02e5-4321-8b06-00a8ac101dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309eb0cd7ce449778d17fa8d3f60dcd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:25Z,use_quota=True,user_id='3f5a131775504e998ccac49253a975eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3115b800-d317-4127-9786-ee0a5d6cb3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3115b800-d317-4127-9786-ee0a5d6cb3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c828cf3-82df-4c60-9b95-ca092abb967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c828cf3-82df-4c60-9b95-ca092abb967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece6412e-02e5-4321-8b06-00a8ac101dbb', 'volume_name': 'volume-ece6412e-02e5-4321-8b06-00a8ac101dbb', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a595ca-d80c-45e1-8fd0-ab8c1b7e5fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a595ca-d80c-45e1-8fd0-ab8c1b7e5fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712beba1-f825-4d8c-9581-7e70d36a9601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:24 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Volume ece6412e-02e5-4321-8b06-00a8ac101dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece6412e-02e5-4321-8b06-00a8ac101dbb', 'volume_size': 1} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:24 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.info" returned: 0 in 0.520s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.653s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1041666733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757ba7a0-81de-4cf0-8eab-36923ad48cf0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:24Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Creating volume 757ba7a0-81de-4cf0-8eab-36923ad48cf0 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:24 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:25 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 1073741824 Apr 13 17:45:25 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:25 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-68c6b902-757e-49fb-80bf-cab154e10a1d tempest-GroupSnapshotsV319Test-1243899573 None] group_snapshot 81398cee-5370-40e5-8449-dba281eeb293: created successfully Apr 13 17:45:25 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 1073741824" returned: 0 in 0.662s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:25 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 Apr 13 17:45:25 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:25 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] group_snapshot 81398cee-5370-40e5-8449-dba281eeb293: deleting Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] group_snapshot 81398cee-5370-40e5-8449-dba281eeb293: deleting {{(pid=82736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Acquiring lock "cinder-quobyte-734d396f-4cc2-490e-945b-0553e8213665" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Lock "cinder-quobyte-734d396f-4cc2-490e-945b-0553e8213665" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Acquiring lock "cinder-quobyte-8c12b892-9592-4cb4-a807-dd28d8e8e374" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Lock "cinder-quobyte-8c12b892-9592-4cb4-a807-dd28d8e8e374" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Deleting offline snapshot 8c12b892-9592-4cb4-a807-dd28d8e8e374 of volume 734d396f-4cc2-490e-945b-0553e8213665 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] snapshot_file for this snap is: volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b256e6a-7e1e-4f90-bca2-745a6f0f30f2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:26 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 Apr 13 17:45:26 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:26 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0" returned: 0 in 0.534s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-867219492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece6412e-02e5-4321-8b06-00a8ac101dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309eb0cd7ce449778d17fa8d3f60dcd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:25Z,use_quota=True,user_id='3f5a131775504e998ccac49253a975eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Creating volume ece6412e-02e5-4321-8b06-00a8ac101dbb {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:26 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b5d55c-38d2-47c1-9e18-643e19f90544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a3dae2-48db-44ee-b03f-b054d8ebed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:26 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Volume volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 (757ba7a0-81de-4cf0-8eab-36923ad48cf0): created successfully Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a3dae2-48db-44ee-b03f-b054d8ebed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:26 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb 1073741824 Apr 13 17:45:26 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (e702db12-c5ff-441f-b1c8-013335dbb097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-99ea4227-056d-42b5-8500-0f9b19545c85 tempest-VolumesGetTest-1159801981 None] Created volume successfully. Apr 13 17:45:26 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374" returned: 0 in 0.553s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-734d396f-4cc2-490e-945b-0553e8213665(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9ca6fd-0137-4eda-ad38-31cb300f27d3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:26 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 Apr 13 17:45:26 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:26 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb 1073741824" returned: 0 in 0.600s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=113,cinder:UPDATE=138,cinder:DELETE=11,cinder:INSERT=26 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:45:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:26 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb Apr 13 17:45:26 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:27 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665" returned: 0 in 0.577s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:27 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 Apr 13 17:45:27 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:27 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb" returned: 0 in 0.426s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712beba1-f825-4d8c-9581-7e70d36a9601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece6412e-02e5-4321-8b06-00a8ac101dbb', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaa9b8d-bad8-4b7a-af87-acaae84277cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:27 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Volume volume-ece6412e-02e5-4321-8b06-00a8ac101dbb (ece6412e-02e5-4321-8b06-00a8ac101dbb): created successfully Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaa9b8d-bad8-4b7a-af87-acaae84277cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Flow 'volume_create_manager' (bd84b128-8309-4afb-a104-e54ecd0092c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:27 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-ee782c40-880f-47da-9adc-91a964b1804a req-13307724-5546-4933-b2bb-54b2929de286 tempest-VolumesSnapshotsTestJSON-1063656232 None] Created volume successfully. Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (f6cc4538-f7ca-435a-babb-af61623d6ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6449d8b-9cad-4394-955b-465937e561e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6449d8b-9cad-4394-955b-465937e561e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1215308924',display_name='tempest-VolumesGetTest-Volume-599874416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb93d80f-571a-4558-9dbd-a1ec0afe1f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:27Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d842f269-9b7d-4238-a0bb-58adc43d7208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d842f269-9b7d-4238-a0bb-58adc43d7208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49eb8228-d291-4726-ab75-f44c2cb895b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49eb8228-d291-4726-ab75-f44c2cb895b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb93d80f-571a-4558-9dbd-a1ec0afe1f8a', 'volume_name': 'volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0075f4-da33-4dd2-bd7f-e85853d72d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0075f4-da33-4dd2-bd7f-e85853d72d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f611af-db5c-46d4-a84e-0625262a73b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:27 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Volume eb93d80f-571a-4558-9dbd-a1ec0afe1f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a', 'volume_size': 1} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1215308924',display_name='tempest-VolumesGetTest-Volume-599874416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb93d80f-571a-4558-9dbd-a1ec0afe1f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:27Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Creating volume eb93d80f-571a-4558-9dbd-a1ec0afe1f8a {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:27 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:27 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a 1073741824 Apr 13 17:45:27 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:27 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374" returned: 0 in 0.542s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:27 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374 Apr 13 17:45:27 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:28 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a 1073741824" returned: 0 in 0.525s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:28 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a Apr 13 17:45:28 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:28 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665.8c12b892-9592-4cb4-a807-dd28d8e8e374" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Lock "cinder-quobyte-8c12b892-9592-4cb4-a807-dd28d8e8e374" released by "_delete_snapshot" :: held 2.214s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Lock "cinder-quobyte-734d396f-4cc2-490e-945b-0553e8213665" released by "delete_snapshot" :: held 2.236s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:28 devstack cinder-volume[82736]: WARNING cinder.quota [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1946461508 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1946461508, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:45:28 devstack cinder-volume[82736]: WARNING cinder.quota [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1946461508 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1946461508, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] Created reservations ['fdd3b2f4-f353-4552-8bea-5ecf6e8aae83', 'ede8894a-b97f-474c-a504-3ade57f49ed9', 'e0d6f5a2-46d7-4911-9af2-7ad85b5aa2bc', '583ce23a-bc9b-4c5e-81bf-3ba374f9f8c1'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:28 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-dfe3b70c-f2bb-4690-b2fa-a0ec123006db tempest-GroupSnapshotsV319Test-1243899573 None] group_snapshot 81398cee-5370-40e5-8449-dba281eeb293: deleted successfully Apr 13 17:45:28 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.321s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f611af-db5c-46d4-a84e-0625262a73b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e62600f-3231-4d40-ba8b-b403ee79255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Creating offline snapshot 00c304c7-d8d3-456a-b994-805d6df30b6b of volume ece6412e-02e5-4321-8b06-00a8ac101dbb {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:45:28 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Volume volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a (eb93d80f-571a-4558-9dbd-a1ec0afe1f8a): created successfully Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e62600f-3231-4d40-ba8b-b403ee79255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (f6cc4538-f7ca-435a-babb-af61623d6ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd97bf0-542d-4bac-a19d-a41c61e19758]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:28 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-bbf5dde4-1db8-4451-bf0e-ec4c40288f9d tempest-VolumesGetTest-1159801981 None] Created volume successfully. Apr 13 17:45:28 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb Apr 13 17:45:28 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:29 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb" returned: 0 in 0.518s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:29 devstack sudo[86388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b 1G Apr 13 17:45:29 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Acquiring lock "cinder-quobyte-734d396f-4cc2-490e-945b-0553e8213665" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Lock "cinder-quobyte-734d396f-4cc2-490e-945b-0553e8213665" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56978a9-b5ed-4f81-b825-d3707da95a94]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:29 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 Apr 13 17:45:29 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Lock "cinder-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a" acquired by "delete_volume" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b208c30-f7c7-403a-a316-addb06613dda]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:29 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b 1G" returned: 0 in 0.659s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece6412e-02e5-4321-8b06-00a8ac101dbb -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:29 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece6412e-02e5-4321-8b06-00a8ac101dbb -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b Apr 13 17:45:29 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:29 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a Apr 13 17:45:29 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:29 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665" returned: 0 in 0.613s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:29 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665 Apr 13 17:45:29 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:30 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a" returned: 0 in 0.473s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:30 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece6412e-02e5-4321-8b06-00a8ac101dbb -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b" returned: 0 in 0.467s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:30 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b is being set with open permissions: ugo+rw Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:30 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a Apr 13 17:45:30 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:30 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b Apr 13 17:45:30 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:30 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-734d396f-4cc2-490e-945b-0553e8213665" returned: 0 in 0.433s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Lock "cinder-quobyte-734d396f-4cc2-490e-945b-0553e8213665" released by "delete_volume" :: held 1.081s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Created reservations ['fe34326b-7c1e-4fe4-837b-03b26376ebfd'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:30 devstack cinder-volume[82736]: WARNING cinder.quota [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1946461508 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1946461508, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Created reservations ['19188064-4d04-4560-848d-c1440c8a8ed9', '3ccf33fb-d058-4ae2-b7f3-11d838a08010', 'd4320673-387b-4c65-a27c-18338420717d', '0a797e3d-a2d3-4972-8ba6-5d22ce047030'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:30 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:30 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:30 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a" returned: 0 in 0.549s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a" released by "delete_volume" :: held 1.052s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Created reservations ['bd052653-bac7-402f-9fc7-92a3e7eefaaf', '499dd68f-74fc-4bdc-b0b9-9eb534081479', '81ee0377-5a4e-46c1-9eef-bc6335e4be70', '74a3cda7-6ece-4b82-a58e-de4445d0add8'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:30 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b" returned: 0 in 0.647s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:31 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:31 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:31 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.info Apr 13 17:45:31 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:31 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.743s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:31 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-73becbfa-c66f-4fd4-a1e1-253f30d13167 tempest-GroupSnapshotsV319Test-1243899573 None] Delete group completed successfully. Apr 13 17:45:31 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.info" returned: 0 in 0.577s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:31 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:31 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.info is being set with open permissions: ugo+rw Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.634s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:31 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Deleted volume successfully. Apr 13 17:45:31 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.info Apr 13 17:45:31 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-664db3b2-3699-420a-9a19-482aa280b97b tempest-VolumesGetTest-1159801981 None] Lock "cinder-eb93d80f-571a-4558-9dbd-a1ec0afe1f8a-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-757ba7a0-81de-4cf0-8eab-36923ad48cf0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Lock "cinder-757ba7a0-81de-4cf0-8eab-36923ad48cf0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-757ba7a0-81de-4cf0-8eab-36923ad48cf0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-757ba7a0-81de-4cf0-8eab-36923ad48cf0" acquired by "delete_volume" :: waited 0.019s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf20ded-1112-47c7-85ab-eaa948948559]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:32 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.info" returned: 0 in 0.529s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.548s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:32 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-5467df5b-87f6-4dab-9d42-8858a3ebf886 req-7a08497f-f48c-49cb-8b51-99ce40263f5a tempest-VolumesSnapshotsTestJSON-1063656232 None] Create snapshot completed successfully Apr 13 17:45:32 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 Apr 13 17:45:32 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "cinder-00c304c7-d8d3-456a-b994-805d6df30b6b-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-00c304c7-d8d3-456a-b994-805d6df30b6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "cinder-quobyte-ece6412e-02e5-4321-8b06-00a8ac101dbb" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-quobyte-ece6412e-02e5-4321-8b06-00a8ac101dbb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "cinder-quobyte-00c304c7-d8d3-456a-b994-805d6df30b6b" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-quobyte-00c304c7-d8d3-456a-b994-805d6df30b6b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Deleting offline snapshot 00c304c7-d8d3-456a-b994-805d6df30b6b of volume ece6412e-02e5-4321-8b06-00a8ac101dbb {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:45:32 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] snapshot_file for this snap is: volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed78fd8-bb91-4ce7-83ca-51a63487f210]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0" returned: 0 in 0.765s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:32 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0 Apr 13 17:45:32 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:32 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b Apr 13 17:45:32 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:33 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-757ba7a0-81de-4cf0-8eab-36923ad48cf0" returned: 0 in 0.578s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-757ba7a0-81de-4cf0-8eab-36923ad48cf0" released by "delete_volume" :: held 1.382s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:33 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b" returned: 0 in 0.649s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ece6412e-02e5-4321-8b06-00a8ac101dbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe8a3f4-fd8d-4b64-914b-d4968e410f11]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Created reservations ['97cabeb7-9cb6-4a7d-b01c-9ca1a6c272d0', '34e706ba-e86e-4d6e-a7af-a3268a2e0ce1', '8576ec23-f9bb-4c33-973c-53ca2a16cec3', '379e22d4-fbff-4d9c-9498-63584ce56003'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:33 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb Apr 13 17:45:33 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:33 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:33 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:34 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb" returned: 0 in 0.607s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:34 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b Apr 13 17:45:34 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:34 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.719s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:34 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Deleted volume successfully. Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a9c2d486-c6f0-402b-980c-eb59178ef719 tempest-VolumesGetTest-1159801981 None] Lock "cinder-757ba7a0-81de-4cf0-8eab-36923ad48cf0-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (feb5e48e-48fa-4524-98d2-4c5c135830ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25abcd52-5c32-4b89-8dae-3523d15e8824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25abcd52-5c32-4b89-8dae-3523d15e8824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1637629485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a76281-54d1-468b-809e-2f04fc6c7a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:35Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1037c827-3c43-4e03-8bae-6ac418697691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1037c827-3c43-4e03-8bae-6ac418697691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e088d431-a666-494f-bb86-f0cf7bde882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e088d431-a666-494f-bb86-f0cf7bde882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a76281-54d1-468b-809e-2f04fc6c7a02', 'volume_name': 'volume-41a76281-54d1-468b-809e-2f04fc6c7a02', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8080aaf6-c07d-46ab-b57a-363734e8d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8080aaf6-c07d-46ab-b57a-363734e8d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ad66d-a73a-4cb8-aee2-859952e5b7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:34 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Volume 41a76281-54d1-468b-809e-2f04fc6c7a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a76281-54d1-468b-809e-2f04fc6c7a02', 'volume_size': 1} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1637629485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a76281-54d1-468b-809e-2f04fc6c7a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:35Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Creating volume 41a76281-54d1-468b-809e-2f04fc6c7a02 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:34 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:34 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 1073741824 Apr 13 17:45:34 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (b9cdcbea-5ce1-494f-8d9a-12ce35e55cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae0ab8f-106d-4238-ac23-ae5fe9ec6ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae0ab8f-106d-4238-ac23-ae5fe9ec6ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-178311110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1591124c-0a67-46e3-95c7-736acfbb33ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:35Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e23094b-40d0-4731-b801-1e82b789cb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e23094b-40d0-4731-b801-1e82b789cb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad92c0d7-d59b-43aa-ac74-2b48fb37a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad92c0d7-d59b-43aa-ac74-2b48fb37a80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1591124c-0a67-46e3-95c7-736acfbb33ca', 'volume_name': 'volume-1591124c-0a67-46e3-95c7-736acfbb33ca', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ebcb1a-f5f2-4641-9c64-e4019d639cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ebcb1a-f5f2-4641-9c64-e4019d639cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e81151-db80-4ab7-9e58-f209b35ccb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:35 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Volume 1591124c-0a67-46e3-95c7-736acfbb33ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1591124c-0a67-46e3-95c7-736acfbb33ca', 'volume_size': 1} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:35 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b" returned: 0 in 0.973s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:35 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b Apr 13 17:45:35 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:35 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 1073741824" returned: 0 in 0.654s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:35 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:UPDATE=173,cinder:SELECT=136,cinder:INSERT=38,cinder:DELETE=10 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb.00c304c7-d8d3-456a-b994-805d6df30b6b" returned: 0 in 0.486s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:35 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 Apr 13 17:45:35 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-quobyte-00c304c7-d8d3-456a-b994-805d6df30b6b" released by "_delete_snapshot" :: held 2.843s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-quobyte-ece6412e-02e5-4321-8b06-00a8ac101dbb" released by "delete_snapshot" :: held 2.870s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.quota [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Created reservations ['d2d089ea-6629-4218-a760-d2ffc12d58bb', '7053a2ef-eaad-481d-9456-2941c2644bb6', '2e7ea3d2-3b28-4766-96d6-d178b219be3f', '82a15cc9-260f-4f84-9a19-37c68732e0ef'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Delete snapshot completed successfully. Apr 13 17:45:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-1e0f7ee8-34a7-4c53-a3ec-106f63c6a328 req-7ad5d98a-6ef7-489e-bb04-dc585979bc75 tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-00c304c7-d8d3-456a-b994-805d6df30b6b-delete_snapshot" released by "delete_snapshot" :: held 2.954s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "cinder-ece6412e-02e5-4321-8b06-00a8ac101dbb-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-ece6412e-02e5-4321-8b06-00a8ac101dbb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:36 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "cinder-quobyte-ece6412e-02e5-4321-8b06-00a8ac101dbb" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02" returned: 0 in 0.507s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-178311110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1591124c-0a67-46e3-95c7-736acfbb33ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:35Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Creating volume 1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:36 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ad66d-a73a-4cb8-aee2-859952e5b7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a76281-54d1-468b-809e-2f04fc6c7a02', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76da4a74-7c7f-4065-9ed1-16ce22f80e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-quobyte-ece6412e-02e5-4321-8b06-00a8ac101dbb" acquired by "delete_volume" :: waited 0.059s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:36 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca 1073741824 Apr 13 17:45:36 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:36 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Volume volume-41a76281-54d1-468b-809e-2f04fc6c7a02 (41a76281-54d1-468b-809e-2f04fc6c7a02): created successfully Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76da4a74-7c7f-4065-9ed1-16ce22f80e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (feb5e48e-48fa-4524-98d2-4c5c135830ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb9c90-30d6-4f77-95b3-4f4c470c6d77]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:36 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d047b71e-f5dd-4ac1-a2e3-2422b91a1e37 tempest-VolumesActionsTest-1720825569 None] Created volume successfully. Apr 13 17:45:36 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb Apr 13 17:45:36 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:36 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca 1073741824" returned: 0 in 0.634s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:36 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb" returned: 0 in 0.593s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:36 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb Apr 13 17:45:36 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:36 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca Apr 13 17:45:36 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cb1beb14-0525-4c37-8b95-b94a18ef6f00 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02" by "attach_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cb1beb14-0525-4c37-8b95-b94a18ef6f00 tempest-VolumesActionsTest-1720825569 None] Lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02" acquired by "attach_volume" :: waited 0.026s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-cb1beb14-0525-4c37-8b95-b94a18ef6f00 tempest-VolumesActionsTest-1720825569 None] Attaching volume 41a76281-54d1-468b-809e-2f04fc6c7a02 to instance 86ab32b5-add4-471d-a0b7-6c55d768bacc at mountpoint /dev/vdb on host None. Apr 13 17:45:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-cb1beb14-0525-4c37-8b95-b94a18ef6f00 tempest-VolumesActionsTest-1720825569 None] Attach volume completed successfully. Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cb1beb14-0525-4c37-8b95-b94a18ef6f00 tempest-VolumesActionsTest-1720825569 None] Lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02" released by "attach_volume" :: held 0.075s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:37 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ece6412e-02e5-4321-8b06-00a8ac101dbb" returned: 0 in 0.603s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-quobyte-ece6412e-02e5-4321-8b06-00a8ac101dbb" released by "delete_volume" :: held 1.237s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.quota [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Created reservations ['e86c8426-c671-46b2-b54a-488c3f4d5212', '72a0deed-d410-45fd-a91a-0ba17f4e3ff6', 'abfbdffa-fd77-43a6-9862-baedefaaae69', 'bc667467-bcb9-4469-93c9-7985421b0cfa'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:37 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:37 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:37 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca" returned: 0 in 0.727s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e81151-db80-4ab7-9e58-f209b35ccb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1591124c-0a67-46e3-95c7-736acfbb33ca', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8ae388-df92-4114-9af1-29ff25c2058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:37 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Volume volume-1591124c-0a67-46e3-95c7-736acfbb33ca (1591124c-0a67-46e3-95c7-736acfbb33ca): created successfully Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8ae388-df92-4114-9af1-29ff25c2058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (b9cdcbea-5ce1-494f-8d9a-12ce35e55cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a64fa0c5-6592-498b-8fe0-29a5dd171c95 tempest-VolumesGetTest-1159801981 None] Created volume successfully. Apr 13 17:45:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-45f0cfe1-fc28-4d9a-bcc1-094dd4eb6009 tempest-VolumesActionsTest-743188947 None] Terminate volume connection completed successfully. Apr 13 17:45:38 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.615s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.manager [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Deleted volume successfully. Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [req-7356d3c7-db1d-43c1-a449-241e515d3daa req-e4395072-8d4a-40c2-8fd5-831374990eaf tempest-VolumesSnapshotsTestJSON-1063656232 None] Lock "cinder-ece6412e-02e5-4321-8b06-00a8ac101dbb-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (68a12f5c-4385-4c25-8bfd-094dc8dde68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fae101c-3acf-4718-9548-1de6e9c7eb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fae101c-3acf-4718-9548-1de6e9c7eb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1504036005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc6748b-284d-4d7e-b56c-db1407510459,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1591124c-0a67-46e3-95c7-736acfbb33ca,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:38Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31dbb4f-2e9e-451f-b337-081c5008bafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31dbb4f-2e9e-451f-b337-081c5008bafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b895ce6-80a6-4ea3-86b2-ddaa63ee1975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-45f0cfe1-fc28-4d9a-bcc1-094dd4eb6009 tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-detach_volume" by "detach_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b895ce6-80a6-4ea3-86b2-ddaa63ee1975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'acc6748b-284d-4d7e-b56c-db1407510459', 'volume_name': 'volume-acc6748b-284d-4d7e-b56c-db1407510459', 'volume_size': 1, 'source_volid': '1591124c-0a67-46e3-95c7-736acfbb33ca', 'source_volstatus': 'available'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22853c-74e0-41a5-b964-100efcbfe66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22853c-74e0-41a5-b964-100efcbfe66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0df2207-b82c-4e87-ae5d-a193b8bfefd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:38 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Volume acc6748b-284d-4d7e-b56c-db1407510459: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-acc6748b-284d-4d7e-b56c-db1407510459', 'volume_size': 1, 'source_volid': '1591124c-0a67-46e3-95c7-736acfbb33ca', 'source_volstatus': 'available'} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:38 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Cloning volume 1591124c-0a67-46e3-95c7-736acfbb33ca to volume acc6748b-284d-4d7e-b56c-db1407510459 Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-45f0cfe1-fc28-4d9a-bcc1-094dd4eb6009 tempest-VolumesActionsTest-743188947 None] Lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-45f0cfe1-fc28-4d9a-bcc1-094dd4eb6009 tempest-VolumesActionsTest-743188947 None] Detaching volume 41a76281-54d1-468b-809e-2f04fc6c7a02 from instance 86ab32b5-add4-471d-a0b7-6c55d768bacc. Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Creating offline snapshot 23e71224-f107-4b28-a861-f9901ab3d1a9 of volume 1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d007bd15-ac17-403c-88c7-3f59a4ee329d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-45f0cfe1-fc28-4d9a-bcc1-094dd4eb6009 tempest-VolumesActionsTest-743188947 None] Detach volume completed successfully. Apr 13 17:45:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-45f0cfe1-fc28-4d9a-bcc1-094dd4eb6009 tempest-VolumesActionsTest-743188947 None] Lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:38 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca Apr 13 17:45:38 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a7ada7ae-6fce-4219-ad33-6a6ba8793f0d tempest-VolumesActionsTest-1720825569 None] Acquiring lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-detach_volume" by "detach_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a7ada7ae-6fce-4219-ad33-6a6ba8793f0d tempest-VolumesActionsTest-1720825569 None] Lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:39 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a7ada7ae-6fce-4219-ad33-6a6ba8793f0d tempest-VolumesActionsTest-1720825569 None] Volume detach called, but volume not attached. Apr 13 17:45:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a7ada7ae-6fce-4219-ad33-6a6ba8793f0d tempest-VolumesActionsTest-1720825569 None] Lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:39 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca" returned: 0 in 0.699s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:39 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 1G Apr 13 17:45:39 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Acquiring lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Acquiring lock "cinder-quobyte-41a76281-54d1-468b-809e-2f04fc6c7a02" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Lock "cinder-quobyte-41a76281-54d1-468b-809e-2f04fc6c7a02" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a280c2b4-9e4c-4cf9-a437-3d1f29cdcbca]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:40 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 Apr 13 17:45:40 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:40 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 1G" returned: 0 in 0.822s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1591124c-0a67-46e3-95c7-736acfbb33ca -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:40 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1591124c-0a67-46e3-95c7-736acfbb33ca -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 Apr 13 17:45:40 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:40 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02" returned: 0 in 0.712s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:40 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02 Apr 13 17:45:40 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:41 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1591124c-0a67-46e3-95c7-736acfbb33ca -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9" returned: 0 in 0.808s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:41 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 is being set with open permissions: ugo+rw Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:41 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 Apr 13 17:45:41 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:41 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-41a76281-54d1-468b-809e-2f04fc6c7a02" returned: 0 in 0.725s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Lock "cinder-quobyte-41a76281-54d1-468b-809e-2f04fc6c7a02" released by "delete_volume" :: held 1.460s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Created reservations ['b7e085e9-a8c4-4282-aeb4-ae2e405f57a2', '40a8d6bc-7fc5-4f9e-91f7-cbad63ba5b1e', 'df1bc889-ae12-461f-b27f-13bab3470fe9', 'e86e024f-a987-432e-b81d-8599cbc96a23'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:41 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:41 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:41 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9" returned: 0 in 0.849s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:41 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.info Apr 13 17:45:41 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:42 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b0478907-78af-4498-b41e-d26252f0b91c tempest-GroupSnapshotsTest-1545235004 None] Group tempest-GroupSnapshotsTest-Group-422466788: creating Apr 13 17:45:42 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b0478907-78af-4498-b41e-d26252f0b91c tempest-GroupSnapshotsTest-1545235004 None] Group tempest-GroupSnapshotsTest-Group-422466788: created successfully Apr 13 17:45:42 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b0478907-78af-4498-b41e-d26252f0b91c tempest-GroupSnapshotsTest-1545235004 None] Create group completed successfully. Apr 13 17:45:42 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.516s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:42 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:42 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Deleted volume successfully. Apr 13 17:45:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c51d63d0-d21e-4d56-b2c4-ac18e9b43e0d tempest-VolumesActionsTest-1720825569 None] Lock "cinder-41a76281-54d1-468b-809e-2f04fc6c7a02-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:42 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.info" returned: 0 in 0.658s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:42 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.info is being set with open permissions: ugo+rw Apr 13 17:45:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:42 devstack sudo[86591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.info Apr 13 17:45:42 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:43 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.info" returned: 0 in 0.518s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-acc6748b-284d-4d7e-b56c-db1407510459" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-acc6748b-284d-4d7e-b56c-db1407510459" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] snapshot: 23e71224-f107-4b28-a861-f9901ab3d1a9, volume: acc6748b-284d-4d7e-b56c-db1407510459, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a988406b-2390-4d2c-a76b-adebf6e815b5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:43 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 Apr 13 17:45:43 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Flow 'volume_create_manager' (634b1129-f0ac-4d3b-a013-50cf93f89ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be657d86-2261-4dda-b462-6d80f300c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be657d86-2261-4dda-b462-6d80f300c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1239416930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8770fbf7-76f6-41c6-bffe-0d37e898111d,host='devstack@QuobyteHD#QuobyteHD',id=5c6e9821-a41f-45fe-903a-3562827b3e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6fb70dc31f4910891155ff9977cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:43Z,use_quota=True,user_id='4b56bae7b95243628556403352e49cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aabd1c6-ab49-4757-b4d6-4dfd8a37ece2),volume_type_id=0aabd1c6-ab49-4757-b4d6-4dfd8a37ece2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d55f7b2-822a-47fb-8414-0793771191c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d55f7b2-822a-47fb-8414-0793771191c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d66f0f-4b8c-4fe6-9742-1306798885da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d66f0f-4b8c-4fe6-9742-1306798885da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6e9821-a41f-45fe-903a-3562827b3e3a', 'volume_name': 'volume-5c6e9821-a41f-45fe-903a-3562827b3e3a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e47a6bc-1ba7-4832-adbf-993f8901ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e47a6bc-1ba7-4832-adbf-993f8901ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfea0fba-fc8b-4756-a11b-27e94f5bb148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:43 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Volume 5c6e9821-a41f-45fe-903a-3562827b3e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6e9821-a41f-45fe-903a-3562827b3e3a', 'volume_size': 1} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:43 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9" returned: 0 in 0.805s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1591124c-0a67-46e3-95c7-736acfbb33ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca5d299-a6b6-42d6-8192-b9ce5155f050]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:44 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca Apr 13 17:45:44 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:44 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca" returned: 0 in 0.636s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:44 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:45:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:44 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 Apr 13 17:45:44 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Flow 'volume_create_manager' (4c82f8a1-cc3f-48bf-9cc9-6feccc7526fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2700c25-07e6-4758-8ffd-b60652c7cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2700c25-07e6-4758-8ffd-b60652c7cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-566181254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f733ad-4c25-4ab8-9bbe-359b5c5a5070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa127d47bd97435b8d5eb7961be96ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:45Z,use_quota=True,user_id='75bf4fd031d340199bc978cb31355d1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4f3416-9dfd-41ad-a879-020f7038425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4f3416-9dfd-41ad-a879-020f7038425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4267429f-61e1-415c-a12e-caef0054ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4267429f-61e1-415c-a12e-caef0054ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f733ad-4c25-4ab8-9bbe-359b5c5a5070', 'volume_name': 'volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36a78bd-88a8-4710-81b2-641b6626e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36a78bd-88a8-4710-81b2-641b6626e877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5bfdae-2de5-435d-b1e2-1ea1f3b44c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:45 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Volume 40f733ad-4c25-4ab8-9bbe-359b5c5a5070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070', 'volume_size': 1} Apr 13 17:45:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:46 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459" returned: 0 in 2.379s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:47 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ae426-7b6d-412d-9ccc-57bce6365247]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:47 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca Apr 13 17:45:47 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:47 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca" returned: 0 in 0.636s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:47 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:45:47 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Converted 1024.00 MB image at 430.15 MB/s Apr 13 17:45:47 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 is being set with open permissions: ugo+rw Apr 13 17:45:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:47 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 Apr 13 17:45:47 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:48 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459" returned: 0 in 0.453s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-acc6748b-284d-4d7e-b56c-db1407510459" released by "_copy_volume_from_snapshot" :: held 4.984s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-23e71224-f107-4b28-a861-f9901ab3d1a9" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-23e71224-f107-4b28-a861-f9901ab3d1a9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Deleting offline snapshot 23e71224-f107-4b28-a861-f9901ab3d1a9 of volume 1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] snapshot_file for this snap is: volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[af51ef44-0225-4562-b190-5ec2a9c838a4]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:48 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 Apr 13 17:45:48 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:48 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9" returned: 0 in 0.485s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1591124c-0a67-46e3-95c7-736acfbb33ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe09483-a396-4c22-bb71-3fe9120f9e4c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:48 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca Apr 13 17:45:48 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (b600b726-ec9c-42fe-9994-8d4428bcdeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8baf37-00fd-427d-bd91-709a00b8ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8baf37-00fd-427d-bd91-709a00b8ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1260411648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc33b4c4-77d4-4812-aee5-6677b9c08fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:49Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9a55f6-6150-4fb9-8610-d126fa2f8011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9a55f6-6150-4fb9-8610-d126fa2f8011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b833dd-dcb6-4b46-a291-c50292e9c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b833dd-dcb6-4b46-a291-c50292e9c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc33b4c4-77d4-4812-aee5-6677b9c08fd7', 'volume_name': 'volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d568cfee-69bb-40ca-b35c-921fd46bd56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d568cfee-69bb-40ca-b35c-921fd46bd56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7b4051-96a2-40b7-b850-9a1f16ae5275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:48 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Volume bc33b4c4-77d4-4812-aee5-6677b9c08fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7', 'volume_size': 1} Apr 13 17:45:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:49 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca" returned: 0 in 0.509s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:49 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 Apr 13 17:45:49 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:49 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9" returned: 0 in 0.476s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:49 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9 Apr 13 17:45:49 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:50 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca.23e71224-f107-4b28-a861-f9901ab3d1a9" returned: 0 in 0.403s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-23e71224-f107-4b28-a861-f9901ab3d1a9" released by "_delete_snapshot" :: held 1.923s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.435s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.544s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8770fbf7-76f6-41c6-bffe-0d37e898111d,created_at=2026-04-13T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1239416930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8770fbf7-76f6-41c6-bffe-0d37e898111d,host='devstack@QuobyteHD#QuobyteHD',id=5c6e9821-a41f-45fe-903a-3562827b3e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6fb70dc31f4910891155ff9977cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:43Z,use_quota=True,user_id='4b56bae7b95243628556403352e49cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aabd1c6-ab49-4757-b4d6-4dfd8a37ece2),volume_type_id=0aabd1c6-ab49-4757-b4d6-4dfd8a37ece2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Creating volume 5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:50 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0df2207-b82c-4e87-ae5d-a193b8bfefd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc6748b-284d-4d7e-b56c-db1407510459', 'volume_size': 1, 'source_volid': '1591124c-0a67-46e3-95c7-736acfbb33ca', 'source_volstatus': 'available'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16a9d34-eace-4ffa-8539-89c6ba0f8088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:50 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a 1073741824 Apr 13 17:45:50 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:50 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Volume volume-acc6748b-284d-4d7e-b56c-db1407510459 (acc6748b-284d-4d7e-b56c-db1407510459): created successfully Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16a9d34-eace-4ffa-8539-89c6ba0f8088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (68a12f5c-4385-4c25-8bfd-094dc8dde68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:50 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-87fcc59a-a294-459b-a15b-f843ac060455 tempest-VolumesGetTest-1159801981 None] Created volume successfully. Apr 13 17:45:50 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a 1073741824" returned: 0 in 0.529s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:50 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a Apr 13 17:45:50 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (d89ce407-a626-445e-ba24-c073522d768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1b6165-eb79-466e-9a6d-cbb7ecb17bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1b6165-eb79-466e-9a6d-cbb7ecb17bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1345301047',display_name='tempest-VolumesGetTest-Volume-607473966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c2c0a0-0f94-429b-a588-76653b2b996e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:51Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1957130d-f1f1-4e99-b135-75b64d2bfd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1957130d-f1f1-4e99-b135-75b64d2bfd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfcfb72-b3ec-465c-a0c4-3da1ae5c9778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfcfb72-b3ec-465c-a0c4-3da1ae5c9778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c2c0a0-0f94-429b-a588-76653b2b996e', 'volume_name': 'volume-e5c2c0a0-0f94-429b-a588-76653b2b996e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84222025-4864-4d73-aad0-7e922a638f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84222025-4864-4d73-aad0-7e922a638f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d44dd2-4ce8-4367-b634-a149a8ea3633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:50 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Volume e5c2c0a0-0f94-429b-a588-76653b2b996e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c2c0a0-0f94-429b-a588-76653b2b996e', 'volume_size': 1} Apr 13 17:45:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:51 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a" returned: 0 in 0.401s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.395s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-566181254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f733ad-4c25-4ab8-9bbe-359b5c5a5070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa127d47bd97435b8d5eb7961be96ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:45Z,use_quota=True,user_id='75bf4fd031d340199bc978cb31355d1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Creating volume 40f733ad-4c25-4ab8-9bbe-359b5c5a5070 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:51 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfea0fba-fc8b-4756-a11b-27e94f5bb148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6e9821-a41f-45fe-903a-3562827b3e3a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:51 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 1073741824 Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657bf486-deb6-40e4-a235-54ab710ca580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:51 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:51 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Volume volume-5c6e9821-a41f-45fe-903a-3562827b3e3a (5c6e9821-a41f-45fe-903a-3562827b3e3a): created successfully Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657bf486-deb6-40e4-a235-54ab710ca580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Flow 'volume_create_manager' (634b1129-f0ac-4d3b-a013-50cf93f89ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:51 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5e2a5d8f-6fac-4c40-97bf-0ac86c7b426f tempest-GroupSnapshotsTest-1545235004 None] Created volume successfully. Apr 13 17:45:51 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] GroupSnapshot 23cab22e-7907-423b-b8c9-b16115e184cb: creating. Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Group snapshot 23cab22e-7907-423b-b8c9-b16115e184cb: creating. {{(pid=82736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:51 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 1073741824" returned: 0 in 0.479s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:51 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 Apr 13 17:45:51 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:51 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070" returned: 0 in 0.432s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.189s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1260411648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc33b4c4-77d4-4812-aee5-6677b9c08fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:49Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Creating volume bc33b4c4-77d4-4812-aee5-6677b9c08fd7 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:51 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5bfdae-2de5-435d-b1e2-1ea1f3b44c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:52 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 1073741824 Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081473af-eb92-401a-a682-da21671a4836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:52 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:52 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Volume volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 (40f733ad-4c25-4ab8-9bbe-359b5c5a5070): created successfully Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081473af-eb92-401a-a682-da21671a4836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Flow 'volume_create_manager' (4c82f8a1-cc3f-48bf-9cc9-6feccc7526fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:52 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-9fbf097f-09a5-4a63-8ac8-5aee526e324e tempest-VolumesServicesTestJSON-1517619222 None] Created volume successfully. Apr 13 17:45:52 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 1073741824" returned: 0 in 0.515s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:52 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 Apr 13 17:45:52 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Acquiring lock "cinder-40f733ad-4c25-4ab8-9bbe-359b5c5a5070-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Lock "cinder-40f733ad-4c25-4ab8-9bbe-359b5c5a5070-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Acquiring lock "cinder-quobyte-40f733ad-4c25-4ab8-9bbe-359b5c5a5070" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Lock "cinder-quobyte-40f733ad-4c25-4ab8-9bbe-359b5c5a5070" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[481e458d-c1d7-4cc7-93be-6334353550fe]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:52 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 Apr 13 17:45:52 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:53 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7" returned: 0 in 0.522s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.319s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1345301047',display_name='tempest-VolumesGetTest-Volume-607473966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c2c0a0-0f94-429b-a588-76653b2b996e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:51Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Creating volume e5c2c0a0-0f94-429b-a588-76653b2b996e {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:53 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7b4051-96a2-40b7-b850-9a1f16ae5275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57da2aa-e070-463a-bd76-dce6c4a84394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:53 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e 1073741824 Apr 13 17:45:53 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:53 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Volume volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 (bc33b4c4-77d4-4812-aee5-6677b9c08fd7): created successfully Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57da2aa-e070-463a-bd76-dce6c4a84394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (b600b726-ec9c-42fe-9994-8d4428bcdeec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:53 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2f67427f-0f1e-4e2b-ab98-4554d56111c6 tempest-VolumesActionsTest-1720825569 None] Created volume successfully. Apr 13 17:45:53 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070" returned: 0 in 0.516s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:53 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070 Apr 13 17:45:53 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:53 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e 1073741824" returned: 0 in 0.529s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:53 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e Apr 13 17:45:53 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:53 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-40f733ad-4c25-4ab8-9bbe-359b5c5a5070" returned: 0 in 0.471s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Lock "cinder-quobyte-40f733ad-4c25-4ab8-9bbe-359b5c5a5070" released by "delete_volume" :: held 1.031s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:53 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Created reservations ['2ce39b23-614a-4e89-aa98-765c87fbda67', '5767b31c-54a1-486b-adc7-cd37fa4f5d66', '140ff16b-4c39-4f4c-bf9d-941644dd2cd3', '5102a17d-a586-45c1-b3de-971bf8fb483c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:54 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:54 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:54 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e" returned: 0 in 0.469s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.774s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d44dd2-4ce8-4367-b634-a149a8ea3633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c2c0a0-0f94-429b-a588-76653b2b996e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87046ef-33aa-4e5a-b209-61dff74337ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:54 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Volume volume-e5c2c0a0-0f94-429b-a588-76653b2b996e (e5c2c0a0-0f94-429b-a588-76653b2b996e): created successfully Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87046ef-33aa-4e5a-b209-61dff74337ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (d89ce407-a626-445e-ba24-c073522d768b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-bc33b4c4-77d4-4812-aee5-6677b9c08fd7-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:54 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-48d20929-78c0-4d5b-8bf9-8fab17fb5f42 tempest-VolumesGetTest-1159801981 None] Created volume successfully. Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Creating offline snapshot 37dfc9ee-347e-429c-8353-5551db667b1c of volume 5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d015f-5486-4bf7-ae2e-5dc3053be848]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Lock "cinder-bc33b4c4-77d4-4812-aee5-6677b9c08fd7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-quobyte-bc33b4c4-77d4-4812-aee5-6677b9c08fd7" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Lock "cinder-quobyte-bc33b4c4-77d4-4812-aee5-6677b9c08fd7" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7407b5a-78dd-4294-b34b-aaf854116ae3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:54 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:54 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:54 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 Apr 13 17:45:54 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:54 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.461s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:54 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Deleted volume successfully. Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a50cf7b1-49f9-4d30-ab9a-ecbee0e03158 tempest-VolumesServicesTestJSON-1517619222 None] Lock "cinder-40f733ad-4c25-4ab8-9bbe-359b5c5a5070-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:54 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a" returned: 0 in 0.538s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:54 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c 1G Apr 13 17:45:54 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:54 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7" returned: 0 in 0.488s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:54 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7 Apr 13 17:45:54 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-e5c2c0a0-0f94-429b-a588-76653b2b996e-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Lock "cinder-e5c2c0a0-0f94-429b-a588-76653b2b996e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-e5c2c0a0-0f94-429b-a588-76653b2b996e" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-e5c2c0a0-0f94-429b-a588-76653b2b996e" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d940551f-58cf-41d0-be07-d62acc11b6a9]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:55 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc33b4c4-77d4-4812-aee5-6677b9c08fd7" returned: 0 in 0.463s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:55 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e Apr 13 17:45:55 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Lock "cinder-quobyte-bc33b4c4-77d4-4812-aee5-6677b9c08fd7" released by "delete_volume" :: held 0.990s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Created reservations ['79970c57-9942-4ea6-9f0a-230921a5d301', 'f059ab2f-b42a-41b7-94b9-0cb17fd47bdc', '7590b89d-ca6c-4d00-95b8-f8ef9887135d', 'e5195b9b-3bee-4f8c-82a4-45953ac857c0'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:55 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:55 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:55 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c 1G" returned: 0 in 0.634s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c6e9821-a41f-45fe-903a-3562827b3e3a -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:55 devstack sudo[86737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c6e9821-a41f-45fe-903a-3562827b3e3a -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c Apr 13 17:45:55 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:55 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e" returned: 0 in 0.541s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:55 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e Apr 13 17:45:55 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:55 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c6e9821-a41f-45fe-903a-3562827b3e3a -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c" returned: 0 in 0.511s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:55 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:55 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.577s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:55 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Deleted volume successfully. Apr 13 17:45:55 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c Apr 13 17:45:55 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ac890ade-ea83-4632-b695-4b0d65c8e960 tempest-VolumesActionsTest-743188947 None] Lock "cinder-bc33b4c4-77d4-4812-aee5-6677b9c08fd7-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:56 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e5c2c0a0-0f94-429b-a588-76653b2b996e" returned: 0 in 0.454s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-e5c2c0a0-0f94-429b-a588-76653b2b996e" released by "delete_volume" :: held 1.033s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Created reservations ['f32d7826-9ae7-4200-b653-4437643af1b8', '8b694862-2df1-4b69-9de6-9e175368face', 'aea6b6bf-d84e-4935-887b-6273db8d233f', '23164ac6-4761-40e9-a03b-8d8b1f8c19f1'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:56 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:56 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:56 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c" returned: 0 in 0.578s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:56 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.info Apr 13 17:45:56 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (7fdf60ac-d36d-44a7-8827-e3f1d8b4ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956e0660-b53a-407b-8a4f-f769d7b1d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956e0660-b53a-407b-8a4f-f769d7b1d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1790555370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c5f8f8-7c5a-487c-879d-070a51055fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:57Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1cb4bc-3aa7-4dea-b738-3ef890848ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1cb4bc-3aa7-4dea-b738-3ef890848ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e88341-c9a6-4909-bac5-2b484f3c3bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e88341-c9a6-4909-bac5-2b484f3c3bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c5f8f8-7c5a-487c-879d-070a51055fbd', 'volume_name': 'volume-83c5f8f8-7c5a-487c-879d-070a51055fbd', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f338d11-25aa-4f60-80e4-386b4d87d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f338d11-25aa-4f60-80e4-386b4d87d99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537034e3-4237-4db7-8277-6bda9170ee04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:56 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Volume 83c5f8f8-7c5a-487c-879d-070a51055fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c5f8f8-7c5a-487c-879d-070a51055fbd', 'volume_size': 1} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:56 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.575s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:56 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Deleted volume successfully. Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-19d427e3-6380-482b-bd60-5a89d33bbf1b tempest-VolumesGetTest-1159801981 None] Lock "cinder-e5c2c0a0-0f94-429b-a588-76653b2b996e-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:56 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.info" returned: 0 in 0.541s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:56 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:45:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:57 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.info Apr 13 17:45:57 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-acc6748b-284d-4d7e-b56c-db1407510459-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Lock "cinder-acc6748b-284d-4d7e-b56c-db1407510459-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-acc6748b-284d-4d7e-b56c-db1407510459" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-acc6748b-284d-4d7e-b56c-db1407510459" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd466f4-d12d-4834-9ad0-9a570bc0595f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:57 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.info" returned: 0 in 0.502s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.416s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1790555370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c5f8f8-7c5a-487c-879d-070a51055fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:45:57Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Creating volume 83c5f8f8-7c5a-487c-879d-070a51055fbd {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:57 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:45:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:57 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd 1073741824 Apr 13 17:45:57 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:57 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 Apr 13 17:45:57 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-63482bc2-9c01-4d20-a69d-7bed45fca038 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot 23cab22e-7907-423b-b8c9-b16115e184cb: created successfully Apr 13 17:45:58 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459" returned: 0 in 0.583s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:58 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd 1073741824" returned: 0 in 0.543s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:58 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459 Apr 13 17:45:58 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:58 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd Apr 13 17:45:58 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:58 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-acc6748b-284d-4d7e-b56c-db1407510459" returned: 0 in 0.473s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-acc6748b-284d-4d7e-b56c-db1407510459" released by "delete_volume" :: held 1.084s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Created reservations ['fc1b722d-ee33-4e14-8406-537d897c68d2', 'f44999c7-d4ca-49f5-a639-b3c2472434a6', '260062d4-8807-4506-a18a-c337aa635141', '764f48cb-c78a-4440-ad50-da131797e68d'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:45:58 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd" returned: 0 in 0.490s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537034e3-4237-4db7-8277-6bda9170ee04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c5f8f8-7c5a-487c-879d-070a51055fbd', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14092bf5-c4ff-4f78-a03d-722feed73787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:45:58 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Volume volume-83c5f8f8-7c5a-487c-879d-070a51055fbd (83c5f8f8-7c5a-487c-879d-070a51055fbd): created successfully Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14092bf5-c4ff-4f78-a03d-722feed73787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (7fdf60ac-d36d-44a7-8827-e3f1d8b4ac51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:45:58 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4e60355e-1de2-4687-af71-8f85ceb5e321 tempest-VolumesActionsTest-1720825569 None] Created volume successfully. Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:58 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:45:58 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-83c5f8f8-7c5a-487c-879d-070a51055fbd-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Lock "cinder-83c5f8f8-7c5a-487c-879d-070a51055fbd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-quobyte-83c5f8f8-7c5a-487c-879d-070a51055fbd" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Lock "cinder-quobyte-83c5f8f8-7c5a-487c-879d-070a51055fbd" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e57520-100d-4ad0-a118-c7a916507446]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:59 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd Apr 13 17:45:59 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:59 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.491s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:45:59 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Deleted volume successfully. Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-054ec710-1aab-4502-a224-d8c34f67c0f8 tempest-VolumesGetTest-1159801981 None] Lock "cinder-acc6748b-284d-4d7e-b56c-db1407510459-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-37dfc9ee-347e-429c-8353-5551db667b1c-2d95edff-6e7b-4e22-b061-9e4a727c060a" by "_create_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-37dfc9ee-347e-429c-8353-5551db667b1c-2d95edff-6e7b-4e22-b061-9e4a727c060a" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Creating volume 2d95edff-6e7b-4e22-b061-9e4a727c060a from snapshot 37dfc9ee-347e-429c-8353-5551db667b1c {{(pid=82736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-2d95edff-6e7b-4e22-b061-9e4a727c060a" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-2d95edff-6e7b-4e22-b061-9e4a727c060a" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] snapshot: 37dfc9ee-347e-429c-8353-5551db667b1c, volume: 2d95edff-6e7b-4e22-b061-9e4a727c060a, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e52e70-1af6-4b57-b43d-0060e3cfb28d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-1591124c-0a67-46e3-95c7-736acfbb33ca-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Lock "cinder-1591124c-0a67-46e3-95c7-736acfbb33ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-1591124c-0a67-46e3-95c7-736acfbb33ca" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-1591124c-0a67-46e3-95c7-736acfbb33ca" acquired by "delete_volume" :: waited 0.018s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:45:59 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c Apr 13 17:45:59 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a6a7e1-8122-422c-96b1-ebcff6ae7ce9]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:59 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd" returned: 0 in 0.712s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:45:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:45:59 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd Apr 13 17:45:59 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:45:59 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca Apr 13 17:45:59 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:00 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c" returned: 0 in 0.628s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c6e9821-a41f-45fe-903a-3562827b3e3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1d8941-8524-448a-9c19-cfde27c3343f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:00 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a Apr 13 17:46:00 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:00 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83c5f8f8-7c5a-487c-879d-070a51055fbd" returned: 0 in 0.573s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:00 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca" returned: 0 in 0.593s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Lock "cinder-quobyte-83c5f8f8-7c5a-487c-879d-070a51055fbd" released by "delete_volume" :: held 1.319s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:00 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca Apr 13 17:46:00 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Created reservations ['8f655cf9-2779-49a4-8747-6af42992d579', 'fb690020-61fd-42c1-a1e2-df6a189790e7', 'c8ec48c7-37ca-4842-a227-ac83782c283c', '4d69331c-a691-45aa-b152-b39a299336a4'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:00 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:00 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:00 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a" returned: 0 in 0.579s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:00 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a Apr 13 17:46:00 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:00 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1591124c-0a67-46e3-95c7-736acfbb33ca" returned: 0 in 0.517s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-1591124c-0a67-46e3-95c7-736acfbb33ca" released by "delete_volume" :: held 1.151s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Created reservations ['95823309-3985-476c-a8f1-c5865d2320d0', 'aef16f17-94f4-4313-9059-43d1f27e500b', '96dcd262-5356-4639-9c6e-8bdfe35dea15', 'ee0317cc-22d9-4d70-809b-20f51e1dc709'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:00 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:00 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:01 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.584s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Deleted volume successfully. Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bb8a2054-bf0a-4866-b8d0-a9fb5791427e tempest-VolumesActionsTest-743188947 None] Lock "cinder-83c5f8f8-7c5a-487c-879d-070a51055fbd-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:01 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (ae6f8980-4fdb-42ed-9550-b8bf2af93271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b167f8-7950-4d44-a5da-f58678c08831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.813s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Deleted volume successfully. Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b167f8-7950-4d44-a5da-f58678c08831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360233089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:02Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed78861-5d37-4079-8008-258c32b0aa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed78861-5d37-4079-8008-258c32b0aa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f208fb9f-f7da-4a24-9588-78469ea71692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f208fb9f-f7da-4a24-9588-78469ea71692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9', 'volume_name': 'volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2903023a-20f6-4eda-ae27-c921518d3e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2903023a-20f6-4eda-ae27-c921518d3e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5d66be-e3f6-4f7d-9227-15897c84ebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:02 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Volume d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9', 'volume_size': 1} Apr 13 17:46:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5fda63b4-122e-4fdd-b7bc-0be31b05f4dc tempest-VolumesGetTest-1159801981 None] Lock "cinder-1591124c-0a67-46e3-95c7-736acfbb33ca-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (33647598-ae2a-46e4-9b30-9e7a7bf6ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5d8b6d-8c82-4438-8932-06dbe5d7b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5d8b6d-8c82-4438-8932-06dbe5d7b720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-432627345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99db56b9-aff5-460b-879e-75c7ac58b645,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:03Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e19fa7e-9ce9-4d7f-bcb7-10719c0d6de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e19fa7e-9ce9-4d7f-bcb7-10719c0d6de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ac3b5f-99b2-4e5a-b5bd-9c107c2ad9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.image.glance [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Creating Keystone auth plugin from conf {{(pid=82736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 17:46:03 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a" returned: 0 in 2.662s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fda52a-f994-4798-92fa-f4f655ead897]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ac3b5f-99b2-4e5a-b5bd-9c107c2ad9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99db56b9-aff5-460b-879e-75c7ac58b645', 'volume_name': 'volume-99db56b9-aff5-460b-879e-75c7ac58b645', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207045a1-20b5-4c0c-b8f7-fc9785d37267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207045a1-20b5-4c0c-b8f7-fc9785d37267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0984b1-1f15-45ec-89fd-b29b8e5482b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Volume 99db56b9-aff5-460b-879e-75c7ac58b645: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99db56b9-aff5-460b-879e-75c7ac58b645', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Trying to clone 99db56b9-aff5-460b-879e-75c7ac58b645 from image c37de8a8-6952-44d2-a609-d35b5a83220f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]). {{(pid=82736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 13 17:46:03 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a Apr 13 17:46:03 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Flow 'volume_create_manager' (39215374-bd2c-4e59-81f7-db04a7baf5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289a2d2a-7fc0-4a53-afed-1b9a1d67de67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289a2d2a-7fc0-4a53-afed-1b9a1d67de67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-712744749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31968bf0-5440-4cb3-a402-afd63e38512c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefda4dd61b2463991d88fa0a4b5bda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:04Z,use_quota=True,user_id='e511f5e2c4ab4b27bb2a8ba6f25cdb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5a50989-4d5e-4179-8863-ecf3446f3ae7),volume_type_id=d5a50989-4d5e-4179-8863-ecf3446f3ae7)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04d1675-01a6-4169-9802-1ffbec32bb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04d1675-01a6-4169-9802-1ffbec32bb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b63ca0e-96ad-453f-b300-ade909e0a575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b63ca0e-96ad-453f-b300-ade909e0a575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31968bf0-5440-4cb3-a402-afd63e38512c', 'volume_name': 'volume-31968bf0-5440-4cb3-a402-afd63e38512c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bafff47-e0fa-4ac6-9468-47de411229e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bafff47-e0fa-4ac6-9468-47de411229e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf47ff2f-a581-46a1-9519-a9511bc1d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:03 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Volume 31968bf0-5440-4cb3-a402-afd63e38512c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31968bf0-5440-4cb3-a402-afd63e38512c', 'volume_size': 1} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 17:46:03 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Image download 20.69 MB at 20.69 MB/s Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6d6f41-9639-45ae-9a97-f6b850e779f7]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:03 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD Apr 13 17:46:03 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:04 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a" returned: 0 in 0.649s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a, size 1024.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:46:04 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Converted 1024.00 MB image at 384.56 MB/s Apr 13 17:46:04 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:04 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a Apr 13 17:46:04 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:04 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Temporary image c37de8a8-6952-44d2-a609-d35b5a83220f is fetched for user bf1f154c91784ad7897a6dca1a05ca91. {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca7d6ef-f465-4a25-a054-34e7dffcf534]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:04 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD Apr 13 17:46:04 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:04 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a" returned: 0 in 0.402s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-2d95edff-6e7b-4e22-b061-9e4a727c060a" released by "_copy_volume_from_snapshot" :: held 5.012s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-37dfc9ee-347e-429c-8353-5551db667b1c-2d95edff-6e7b-4e22-b061-9e4a727c060a" released by "_create_volume_from_snapshot" :: held 5.027s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.037s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.520s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360233089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:02Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Creating volume d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:04 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:04 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 1073741824 Apr 13 17:46:04 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:04 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a1bbf477-2160-42e1-bf83-5b3eea69cc9c tempest-GroupSnapshotsTest-1545235004 None] Create group from source-snapshot-23cab22e-7907-423b-b8c9-b16115e184cb completed successfully. Apr 13 17:46:04 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:05 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 1073741824" returned: 0 in 0.512s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:05 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 Apr 13 17:46:05 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-2d95edff-6e7b-4e22-b061-9e4a727c060a" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-2d95edff-6e7b-4e22-b061-9e4a727c060a" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[52445359-a8d8-4539-8f93-8dadea86e1c0]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:05 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9" returned: 0 in 0.452s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-712744749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31968bf0-5440-4cb3-a402-afd63e38512c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefda4dd61b2463991d88fa0a4b5bda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:04Z,use_quota=True,user_id='e511f5e2c4ab4b27bb2a8ba6f25cdb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5a50989-4d5e-4179-8863-ecf3446f3ae7),volume_type_id=d5a50989-4d5e-4179-8863-ecf3446f3ae7)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Creating volume 31968bf0-5440-4cb3-a402-afd63e38512c {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:05 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5d66be-e3f6-4f7d-9227-15897c84ebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7389a19-c669-45cf-b51d-e95d699b501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:05 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c 1073741824 Apr 13 17:46:05 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:05 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Volume volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 (d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9): created successfully Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7389a19-c669-45cf-b51d-e95d699b501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (ae6f8980-4fdb-42ed-9550-b8bf2af93271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:05 devstack sudo[86852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a Apr 13 17:46:05 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:05 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5fd2b47b-fbec-46d5-a55f-700bd9ae7ebe tempest-VolumesActionsTest-1720825569 None] Created volume successfully. Apr 13 17:46:06 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a" returned: 0 in 0.499s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:06 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a Apr 13 17:46:06 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:06 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c 1073741824" returned: 0 in 0.547s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:06 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c Apr 13 17:46:06 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Lock "cinder-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-quobyte-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Lock "cinder-quobyte-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[94015a26-0e62-47d4-9d17-7f347ea2cf93]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:06 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 Apr 13 17:46:06 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:06 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2d95edff-6e7b-4e22-b061-9e4a727c060a" returned: 0 in 0.447s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-2d95edff-6e7b-4e22-b061-9e4a727c060a" released by "delete_volume" :: held 0.967s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['efffe390-a08e-49dd-9cac-457ce3bfd64c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:06 devstack cinder-volume[82736]: WARNING cinder.quota [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1195731276 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1195731276, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:46:06 devstack cinder-volume[82736]: WARNING cinder.quota [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1195731276 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1195731276, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['635e9d75-ffa0-4ef3-b718-87e3d9cbfacc', 'a41b1a6d-7f6c-4098-97eb-a806f35f81a5', '65d64553-5eae-4bc1-a230-65fd6255e93c', 'e32c48ba-7745-468b-b65b-127421e481d0'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:06 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:06 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:06 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-432627345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99db56b9-aff5-460b-879e-75c7ac58b645,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:03Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Creating volume 99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:06 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf47ff2f-a581-46a1-9519-a9511bc1d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31968bf0-5440-4cb3-a402-afd63e38512c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f55bcb-f68d-4ab9-9c33-13a7a4d2eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:06 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 1073741824 Apr 13 17:46:06 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:06 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Volume volume-31968bf0-5440-4cb3-a402-afd63e38512c (31968bf0-5440-4cb3-a402-afd63e38512c): created successfully Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f55bcb-f68d-4ab9-9c33-13a7a4d2eb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Flow 'volume_create_manager' (39215374-bd2c-4e59-81f7-db04a7baf5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:06 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-aa93b21e-e08c-458e-bdec-af6a9fce6785 tempest-VolumeTypesAccessTest-629762245 None] Created volume successfully. Apr 13 17:46:06 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9" returned: 0 in 0.529s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:06 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9 Apr 13 17:46:06 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Acquiring lock "cinder-31968bf0-5440-4cb3-a402-afd63e38512c-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Lock "cinder-31968bf0-5440-4cb3-a402-afd63e38512c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Acquiring lock "cinder-quobyte-31968bf0-5440-4cb3-a402-afd63e38512c" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Lock "cinder-quobyte-31968bf0-5440-4cb3-a402-afd63e38512c" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8427d0c-e9bf-4f27-bc36-0eec6672f60f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:07 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c Apr 13 17:46:07 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:07 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.495s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f38170b2-9f00-4b19-9e0b-3b22d51d7130 tempest-GroupSnapshotsTest-1545235004 None] Delete group completed successfully. Apr 13 17:46:07 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 1073741824" returned: 0 in 0.538s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:07 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 Apr 13 17:46:07 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:07 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9" returned: 0 in 0.501s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Lock "cinder-quobyte-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9" released by "delete_volume" :: held 1.049s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Created reservations ['1d753081-8bce-4a82-9307-924ac1bbdd9e', 'b59c352e-4839-4d82-9110-0dcfac2b12d1', '2d80a2a9-a48c-42a4-83cb-0a3163f3ea39', '30c720be-b237-41d5-92e3-8e0055209c10'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:07 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:07 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:07 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c" returned: 0 in 0.521s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:07 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c Apr 13 17:46:07 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:07 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645" returned: 0 in 0.466s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot 23cab22e-7907-423b-b8c9-b16115e184cb: deleting Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot 23cab22e-7907-423b-b8c9-b16115e184cb: deleting {{(pid=82736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Attempting download of c37de8a8-6952-44d2-a609-d35b5a83220f ((None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}])) to volume 99db56b9-aff5-460b-879e-75c7ac58b645. {{(pid=82736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-5c6e9821-a41f-45fe-903a-3562827b3e3a" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-5c6e9821-a41f-45fe-903a-3562827b3e3a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-37dfc9ee-347e-429c-8353-5551db667b1c" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-37dfc9ee-347e-429c-8353-5551db667b1c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Deleting offline snapshot 37dfc9ee-347e-429c-8353-5551db667b1c of volume 5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] snapshot_file for this snap is: volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea5a33e-5048-46ef-b185-28473b46576b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2263cdc4-1c24-4a61-a44d-a3f0c8c6a6b7]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f__cpvplny {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:07 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.447s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Deleted volume successfully. Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b75122a-3123-4cae-a57a-9222a8a72865 tempest-VolumesActionsTest-743188947 None] Lock "cinder-d6ebe3a9-e0a6-4b20-a9a8-dfebaae3f1b9-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:07 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c Apr 13 17:46:07 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:07 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f__cpvplny Apr 13 17:46:07 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:07 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31968bf0-5440-4cb3-a402-afd63e38512c" returned: 0 in 0.460s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Lock "cinder-quobyte-31968bf0-5440-4cb3-a402-afd63e38512c" released by "delete_volume" :: held 1.005s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:07 devstack cinder-volume[82736]: WARNING cinder.quota [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2127205900 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2127205900, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:46:07 devstack cinder-volume[82736]: WARNING cinder.quota [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2127205900 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2127205900, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Created reservations ['f073c89d-6f8e-45e9-904b-9391890a3cc5', '69cee3e9-1f9a-4a22-9697-5fc686b56326', 'f0668b7c-c89d-45f1-a7ac-29c38f3832b4', 'bde3ef72-b4f1-457a-b2e8-89320d456b9f'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:08 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:08 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:08 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c" returned: 0 in 0.515s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c6e9821-a41f-45fe-903a-3562827b3e3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:46:08 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[23444c4a-5e0d-4f05-8891-92b9d0f98f07]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f__cpvplny" returned: 0 in 0.537s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f__cpvplny {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:08 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a Apr 13 17:46:08 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:08 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f__cpvplny Apr 13 17:46:08 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:08 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.477s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:08 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Deleted volume successfully. Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0659387c-6487-49e3-89df-854825e7be46 tempest-VolumeTypesAccessTest-629762245 None] Lock "cinder-31968bf0-5440-4cb3-a402-afd63e38512c-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (c3917ca5-da44-4ab9-8df3-9c0de2119071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6291d680-2882-472c-a01a-318da05efe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6291d680-2882-472c-a01a-318da05efe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-5977533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e04162-7896-4041-9ed4-3cfddd45a936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:09Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8ff24e-b0e8-4acd-b6cf-90006b42a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8ff24e-b0e8-4acd-b6cf-90006b42a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4ba675-11f7-4f8f-a8bd-5d08fe82a220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4ba675-11f7-4f8f-a8bd-5d08fe82a220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e04162-7896-4041-9ed4-3cfddd45a936', 'volume_name': 'volume-02e04162-7896-4041-9ed4-3cfddd45a936', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3836414-419d-441b-846e-642c44903eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3836414-419d-441b-846e-642c44903eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bef85a-3c39-418f-9efd-5d48e7dea334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:08 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Volume 02e04162-7896-4041-9ed4-3cfddd45a936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e04162-7896-4041-9ed4-3cfddd45a936', 'volume_size': 1} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-5977533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e04162-7896-4041-9ed4-3cfddd45a936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:09Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Creating volume 02e04162-7896-4041-9ed4-3cfddd45a936 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:08 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:08 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 1073741824 Apr 13 17:46:08 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:08 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a" returned: 0 in 0.493s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:08 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f__cpvplny" returned: 1 in 0.501s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f__cpvplny' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4106c6e6-6236-44f8-8e1e-b5284f8a2341]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:08 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c Apr 13 17:46:08 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:08 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD Apr 13 17:46:08 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:09 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 1073741824" returned: 0 in 0.578s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:09 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 Apr 13 17:46:09 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:09 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c" returned: 0 in 0.587s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:09 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c Apr 13 17:46:09 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:09 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD" returned: 0 in 0.639s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] c37de8a8-6952-44d2-a609-d35b5a83220f was qcow2, converting to raw {{(pid=82736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:09 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 Apr 13 17:46:09 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:09 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936" returned: 0 in 0.470s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bef85a-3c39-418f-9efd-5d48e7dea334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e04162-7896-4041-9ed4-3cfddd45a936', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18c0096-eafe-4e0e-b44b-1d8280a17493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:09 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Volume volume-02e04162-7896-4041-9ed4-3cfddd45a936 (02e04162-7896-4041-9ed4-3cfddd45a936): created successfully Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18c0096-eafe-4e0e-b44b-1d8280a17493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (c3917ca5-da44-4ab9-8df3-9c0de2119071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:09 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b44b6cb5-83cd-4aef-93f6-2171b2e1a58b tempest-VolumesActionsTest-1720825569 None] Created volume successfully. Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:09 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:09 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:09 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a.37dfc9ee-347e-429c-8353-5551db667b1c" returned: 0 in 0.509s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-37dfc9ee-347e-429c-8353-5551db667b1c" released by "_delete_snapshot" :: held 2.164s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-5c6e9821-a41f-45fe-903a-3562827b3e3a" released by "delete_snapshot" :: held 2.183s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:09 devstack cinder-volume[82736]: WARNING cinder.quota [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1195731276 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1195731276, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:46:09 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['92ffb7dc-84de-4f37-9cbf-a713cca9f0f3', '94adbf83-f146-4dff-bd5c-c4626f9ea3a4', '4a5a3ed5-5a62-449e-91e9-474f37a4afe4', '4a02b773-3c88-4871-95b4-00bbff902630'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:10 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-cadc6023-db3e-4d78-9584-57ea0b2374a3 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot 23cab22e-7907-423b-b8c9-b16115e184cb: deleted successfully Apr 13 17:46:10 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.589s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:10 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645" returned: 0 in 1.032s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_lkl7swdqdevstack@QuobyteHD, size 112.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:46:10 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Converted 112.00 MB image at 108.46 MB/s Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:10 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 1G Apr 13 17:46:10 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-02e04162-7896-4041-9ed4-3cfddd45a936-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Lock "cinder-02e04162-7896-4041-9ed4-3cfddd45a936-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Acquiring lock "cinder-quobyte-02e04162-7896-4041-9ed4-3cfddd45a936" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Lock "cinder-quobyte-02e04162-7896-4041-9ed4-3cfddd45a936" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15874c0-e97b-45e9-b808-a5dd370c1627]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:11 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 Apr 13 17:46:11 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:11 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 1G" returned: 0 in 0.576s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-5c6e9821-a41f-45fe-903a-3562827b3e3a" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-5c6e9821-a41f-45fe-903a-3562827b3e3a" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7657ea-a960-4773-b394-6d7f1dfac025]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8f3d0-e12e-46a2-a894-749a219577e3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:11 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 Apr 13 17:46:11 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:11 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a Apr 13 17:46:11 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:11 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936" returned: 0 in 0.641s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:11 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936 Apr 13 17:46:11 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:11 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645" returned: 0 in 0.621s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:11 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a" returned: 0 in 0.655s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:11 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a Apr 13 17:46:11 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:11 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 Apr 13 17:46:11 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:11 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-02e04162-7896-4041-9ed4-3cfddd45a936" returned: 0 in 0.462s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Lock "cinder-quobyte-02e04162-7896-4041-9ed4-3cfddd45a936" released by "delete_volume" :: held 1.140s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Created reservations ['b68a5d0d-e767-438a-b663-924b42b3e57d', 'd71acc42-07e3-49b2-b8f1-ccf5ba782f4e', '37805916-4237-402d-9d3e-448563e589cd', 'd662db22-025c-40ee-bf90-98aa0334c86a'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:12 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:12 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:12 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5c6e9821-a41f-45fe-903a-3562827b3e3a" returned: 0 in 0.435s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-5c6e9821-a41f-45fe-903a-3562827b3e3a" released by "delete_volume" :: held 1.148s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['c172feaf-1b76-452b-b1bf-bd26f8951e9f'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:12 devstack cinder-volume[82736]: WARNING cinder.db.sqlalchemy.api [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1195731276'] Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['95995042-ca72-4a3b-928e-3cabd1302897', '2bdcf6ad-2268-4899-a5d9-e3675e3fe606', 'acc14390-f58a-491c-b9c7-3e14d0009cac', '13b4f326-9d48-4bcf-9657-94113a1582b8'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:12 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645" returned: 1 in 0.631s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Downloaded image c37de8a8-6952-44d2-a609-d35b5a83220f ((None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}])) to volume 99db56b9-aff5-460b-879e-75c7ac58b645 successfully. {{(pid=82736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Temporary image c37de8a8-6952-44d2-a609-d35b5a83220f for user bf1f154c91784ad7897a6dca1a05ca91 is deleted. {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Marking volume 99db56b9-aff5-460b-879e-75c7ac58b645 as bootable. {{(pid=82736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Copying metadata from image c37de8a8-6952-44d2-a609-d35b5a83220f to 99db56b9-aff5-460b-879e-75c7ac58b645. {{(pid=82736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Creating volume glance metadata for volume 99db56b9-aff5-460b-879e-75c7ac58b645 backed by image c37de8a8-6952-44d2-a609-d35b5a83220f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:12 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:12 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0984b1-1f15-45ec-89fd-b29b8e5482b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99db56b9-aff5-460b-879e-75c7ac58b645', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e33132-5842-4504-9bbc-c4869b2a017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:12 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Volume volume-99db56b9-aff5-460b-879e-75c7ac58b645 (99db56b9-aff5-460b-879e-75c7ac58b645): created successfully Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e33132-5842-4504-9bbc-c4869b2a017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (33647598-ae2a-46e4-9b30-9e7a7bf6ee53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:12 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-00bbfc8f-b088-4942-b157-f29547c5f370 tempest-VolumesGetTest-1159801981 None] Created volume successfully. Apr 13 17:46:12 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.520s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:12 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Deleted volume successfully. Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f8220b9a-ac44-4a3c-8f5f-b6fd11aba5c5 tempest-VolumesActionsTest-743188947 None] Lock "cinder-02e04162-7896-4041-9ed4-3cfddd45a936-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:12 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.477s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:12 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:12 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-55a5a574-2d5d-47fa-a769-7c04473c1930 tempest-GroupSnapshotsTest-1545235004 None] Delete group completed successfully. Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (da1a8b8a-fc1f-43b5-b395-8d067990d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f602895-08d8-47bb-bf09-ef8ccd8e68b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f602895-08d8-47bb-bf09-ef8ccd8e68b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640977739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40f5d35-e43a-4af4-85d4-68ba59c6cd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:13Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f6c96f-03c9-4d63-98e0-02bb3747e186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f6c96f-03c9-4d63-98e0-02bb3747e186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a231fb-7b99-4c85-b10a-99209404ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a231fb-7b99-4c85-b10a-99209404ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40f5d35-e43a-4af4-85d4-68ba59c6cd88', 'volume_name': 'volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00052df6-0ea1-4b2c-b7a5-b33b7f7b56a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00052df6-0ea1-4b2c-b7a5-b33b7f7b56a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f77f66f-1655-40f8-95bf-256f25430971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:13 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Volume c40f5d35-e43a-4af4-85d4-68ba59c6cd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88', 'volume_size': 1} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640977739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40f5d35-e43a-4af4-85d4-68ba59c6cd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7aa47294fd5485a91981cee861d3b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:13Z,use_quota=True,user_id='c06a40fac720485eb86040a77d4fa039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Creating volume c40f5d35-e43a-4af4-85d4-68ba59c6cd88 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:13 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:13 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 1073741824 Apr 13 17:46:13 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:13 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ba075c70-d3c6-4bad-b3ad-34987047e1ea tempest-GroupSnapshotsTest-1545235004 None] Group tempest-GroupSnapshotsTest-Group-1389049665: creating Apr 13 17:46:13 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ba075c70-d3c6-4bad-b3ad-34987047e1ea tempest-GroupSnapshotsTest-1545235004 None] Group tempest-GroupSnapshotsTest-Group-1389049665: created successfully Apr 13 17:46:13 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ba075c70-d3c6-4bad-b3ad-34987047e1ea tempest-GroupSnapshotsTest-1545235004 None] Create group completed successfully. Apr 13 17:46:13 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 1073741824" returned: 0 in 0.544s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:13 devstack sudo[87004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 Apr 13 17:46:13 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (d851dd83-fcd3-4b73-94db-6ecb1b8cb777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e1d1a0-de44-488e-b8b3-4de988d81bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e1d1a0-de44-488e-b8b3-4de988d81bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-682401354',display_name='tempest-VolumesGetTest-Volume-1368064830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298f427f-47e6-4fa4-b6db-1129ec7d6eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:14Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73c6e91-db33-41d1-8c3a-0bb1cc9147f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73c6e91-db33-41d1-8c3a-0bb1cc9147f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b031236-8d4f-4fcf-9879-bc4ecb6c4c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b031236-8d4f-4fcf-9879-bc4ecb6c4c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298f427f-47e6-4fa4-b6db-1129ec7d6eb7', 'volume_name': 'volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c4f7ae-fc5d-4189-bd64-4c427672e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c4f7ae-fc5d-4189-bd64-4c427672e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2551b125-fc1d-4664-82d9-279eb65d29c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:14 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Volume 298f427f-47e6-4fa4-b6db-1129ec7d6eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7', 'volume_size': 1} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:14 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88" returned: 0 in 0.491s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-682401354',display_name='tempest-VolumesGetTest-Volume-1368064830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298f427f-47e6-4fa4-b6db-1129ec7d6eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f72502e16424b0db3c62100f3aa1ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:14Z,use_quota=True,user_id='bf1f154c91784ad7897a6dca1a05ca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Creating volume 298f427f-47e6-4fa4-b6db-1129ec7d6eb7 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:14 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f77f66f-1655-40f8-95bf-256f25430971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3371cf-efd5-4261-8e90-22b034119bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:14 devstack sudo[87007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 1073741824 Apr 13 17:46:14 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:14 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Volume volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 (c40f5d35-e43a-4af4-85d4-68ba59c6cd88): created successfully Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3371cf-efd5-4261-8e90-22b034119bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Flow 'volume_create_manager' (da1a8b8a-fc1f-43b5-b395-8d067990d132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:14 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-9ace5385-7136-401a-99e4-40b117c53920 tempest-VolumesActionsTest-1720825569 None] Created volume successfully. Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Flow 'volume_create_manager' (b7b7b09e-8a29-4dc9-97d3-58652f797f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc4a88f-d6a7-499a-8518-e77931e36696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:15 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 1073741824" returned: 0 in 0.627s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc4a88f-d6a7-499a-8518-e77931e36696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1093827695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fcbb09a-37e7-4610-8efb-1a6e99754f2b,host='devstack@QuobyteHD#QuobyteHD',id=3f739c4f-792d-4271-81e4-e9718af8f99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6fb70dc31f4910891155ff9977cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:15Z,use_quota=True,user_id='4b56bae7b95243628556403352e49cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3bc5c1f-9a0d-45da-8cae-1b0eaeb7e167),volume_type_id=f3bc5c1f-9a0d-45da-8cae-1b0eaeb7e167)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a375926-c9ed-4d09-aa0d-39c72c911c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a375926-c9ed-4d09-aa0d-39c72c911c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3292ec4-955b-4a96-ad27-26471a14fed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3292ec4-955b-4a96-ad27-26471a14fed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f739c4f-792d-4271-81e4-e9718af8f99a', 'volume_name': 'volume-3f739c4f-792d-4271-81e4-e9718af8f99a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440bee1a-c345-49a6-b77b-308670b7ea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440bee1a-c345-49a6-b77b-308670b7ea69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52327bca-b0a5-4f64-b7cb-677ffe51f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Volume 3f739c4f-792d-4271-81e4-e9718af8f99a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f739c4f-792d-4271-81e4-e9718af8f99a', 'volume_size': 1} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:15 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 Apr 13 17:46:15 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:15 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7" returned: 0 in 0.467s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fcbb09a-37e7-4610-8efb-1a6e99754f2b,created_at=2026-04-13T15:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1093827695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fcbb09a-37e7-4610-8efb-1a6e99754f2b,host='devstack@QuobyteHD#QuobyteHD',id=3f739c4f-792d-4271-81e4-e9718af8f99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6fb70dc31f4910891155ff9977cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:15Z,use_quota=True,user_id='4b56bae7b95243628556403352e49cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3bc5c1f-9a0d-45da-8cae-1b0eaeb7e167),volume_type_id=f3bc5c1f-9a0d-45da-8cae-1b0eaeb7e167)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Creating volume 3f739c4f-792d-4271-81e4-e9718af8f99a {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:15 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:15 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a 1073741824 Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2551b125-fc1d-4664-82d9-279eb65d29c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:15 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c6195d-89c8-43a0-bfe7-e73679f91155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Volume volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 (298f427f-47e6-4fa4-b6db-1129ec7d6eb7): created successfully Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c6195d-89c8-43a0-bfe7-e73679f91155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Flow 'volume_create_manager' (d851dd83-fcd3-4b73-94db-6ecb1b8cb777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:15 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-eadb84b0-431b-40cc-a72b-6b03e2a539b8 tempest-VolumesGetTest-1159801981 None] Created volume successfully. Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "cinder-c40f5d35-e43a-4af4-85d4-68ba59c6cd88-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Lock "cinder-c40f5d35-e43a-4af4-85d4-68ba59c6cd88-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "cinder-quobyte-c40f5d35-e43a-4af4-85d4-68ba59c6cd88" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Lock "cinder-quobyte-c40f5d35-e43a-4af4-85d4-68ba59c6cd88" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97c159f-d3c0-44db-8c0f-df2be9691200]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:16 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 Apr 13 17:46:16 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:16 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-298f427f-47e6-4fa4-b6db-1129ec7d6eb7-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a 1073741824" returned: 0 in 0.638s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Lock "cinder-298f427f-47e6-4fa4-b6db-1129ec7d6eb7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-298f427f-47e6-4fa4-b6db-1129ec7d6eb7" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:16 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a Apr 13 17:46:16 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-298f427f-47e6-4fa4-b6db-1129ec7d6eb7" acquired by "delete_volume" :: waited 0.028s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72f6bdb-4c36-4215-ab67-b72f4efdb09b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:16 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 Apr 13 17:46:16 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:16 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88" returned: 0 in 0.601s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:16 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88 Apr 13 17:46:16 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:16 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a" returned: 0 in 0.452s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52327bca-b0a5-4f64-b7cb-677ffe51f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f739c4f-792d-4271-81e4-e9718af8f99a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8659665e-b5e5-46b9-b488-d7091b8d6390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Volume volume-3f739c4f-792d-4271-81e4-e9718af8f99a (3f739c4f-792d-4271-81e4-e9718af8f99a): created successfully Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8659665e-b5e5-46b9-b488-d7091b8d6390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Flow 'volume_create_manager' (b7b7b09e-8a29-4dc9-97d3-58652f797f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:16 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-8d11a67f-98dc-4e23-a414-3206e690709b tempest-GroupSnapshotsTest-1545235004 None] Created volume successfully. Apr 13 17:46:16 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7" returned: 0 in 0.550s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:16 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7 Apr 13 17:46:16 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:17 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c40f5d35-e43a-4af4-85d4-68ba59c6cd88" returned: 0 in 0.523s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Lock "cinder-quobyte-c40f5d35-e43a-4af4-85d4-68ba59c6cd88" released by "delete_volume" :: held 1.164s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Created reservations ['a5fa8242-e544-447c-a5d1-f5e5f6ca9f13', 'c1c74806-abdb-423b-b6de-7e57e9cd22ef', 'aabc51d2-6b56-4054-909f-c74af4c3d6fd', '5cff8577-7104-4b46-8421-de46271136d8'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:17 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:17 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:17 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-298f427f-47e6-4fa4-b6db-1129ec7d6eb7" returned: 0 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-298f427f-47e6-4fa4-b6db-1129ec7d6eb7" released by "delete_volume" :: held 1.105s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Created reservations ['6d21f69e-8a51-4e66-a827-01cddc89f184', 'f2fce2b4-6aec-45b5-a533-1b1fd98d3433', 'f959e08a-4b70-474f-8677-086360236dc1', 'b56e3281-afc2-46d6-9979-1828f91a5add'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:17 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:17 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Flow 'volume_create_manager' (2c33bae4-b94f-4dfc-acf4-73df6a1ee588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cd615f-23da-4796-835e-475ba31b952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cd615f-23da-4796-835e-475ba31b952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941365264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fcbb09a-37e7-4610-8efb-1a6e99754f2b,host='devstack@QuobyteHD#QuobyteHD',id=f0f4decd-1c7b-4319-84d1-ff605d310ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6fb70dc31f4910891155ff9977cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:18Z,use_quota=True,user_id='4b56bae7b95243628556403352e49cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3bc5c1f-9a0d-45da-8cae-1b0eaeb7e167),volume_type_id=f3bc5c1f-9a0d-45da-8cae-1b0eaeb7e167)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3867779f-5c9e-47bd-bb06-94f64a09dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3867779f-5c9e-47bd-bb06-94f64a09dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae14b0a-8bc1-4bea-a81c-56faed668d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae14b0a-8bc1-4bea-a81c-56faed668d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f4decd-1c7b-4319-84d1-ff605d310ecb', 'volume_name': 'volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56550033-b7ef-49a3-abd9-e3fa6e919e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56550033-b7ef-49a3-abd9-e3fa6e919e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ef770e-e1ce-4887-bd62-5ba4efdc0df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:17 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Volume f0f4decd-1c7b-4319-84d1-ff605d310ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb', 'volume_size': 1} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fcbb09a-37e7-4610-8efb-1a6e99754f2b,created_at=2026-04-13T15:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941365264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fcbb09a-37e7-4610-8efb-1a6e99754f2b,host='devstack@QuobyteHD#QuobyteHD',id=f0f4decd-1c7b-4319-84d1-ff605d310ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6fb70dc31f4910891155ff9977cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:18Z,use_quota=True,user_id='4b56bae7b95243628556403352e49cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3bc5c1f-9a0d-45da-8cae-1b0eaeb7e167),volume_type_id=f3bc5c1f-9a0d-45da-8cae-1b0eaeb7e167)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Creating volume f0f4decd-1c7b-4319-84d1-ff605d310ecb {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:17 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:17 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.537s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Deleted volume successfully. Apr 13 17:46:17 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb 1073741824 Apr 13 17:46:17 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-138db973-885d-48b0-b69d-a0bfd3b41342 tempest-VolumesActionsTest-1720825569 None] Lock "cinder-c40f5d35-e43a-4af4-85d4-68ba59c6cd88-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:18 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.417s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Deleted volume successfully. Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abdaac1e-0b04-44e4-83f0-555e0c878138 tempest-VolumesGetTest-1159801981 None] Lock "cinder-298f427f-47e6-4fa4-b6db-1129ec7d6eb7-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:18 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb 1073741824" returned: 0 in 0.575s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:18 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb Apr 13 17:46:18 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-99db56b9-aff5-460b-879e-75c7ac58b645-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Lock "cinder-99db56b9-aff5-460b-879e-75c7ac58b645-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Acquiring lock "cinder-quobyte-99db56b9-aff5-460b-879e-75c7ac58b645" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-99db56b9-aff5-460b-879e-75c7ac58b645" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0780af3f-2c62-42e1-a136-ae51d345d327]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:18 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 Apr 13 17:46:18 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:18 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb" returned: 0 in 0.540s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ef770e-e1ce-4887-bd62-5ba4efdc0df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23477ff4-89d9-4c9b-bf92-a18a5968ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:18 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Volume volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb (f0f4decd-1c7b-4319-84d1-ff605d310ecb): created successfully Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23477ff4-89d9-4c9b-bf92-a18a5968ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Flow 'volume_create_manager' (2c33bae4-b94f-4dfc-acf4-73df6a1ee588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-32b3082f-eac2-442c-be1c-f5b1bfc5ec42 tempest-GroupSnapshotsTest-1545235004 None] Created volume successfully. Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Flow 'volume_create_manager' (d4dcd93c-e1ee-401c-a73c-36519f02dae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a2c74f-791f-4129-81af-4c9ca3cefae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a2c74f-791f-4129-81af-4c9ca3cefae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2075355843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8846b1-18a0-411f-9062-9adfa410586e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4c0ade4b043409cb82add54fbb970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:19Z,use_quota=True,user_id='2f904be6fcb44289aa3ae08ec1779e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7cdd23-57fa-4ae3-a104-e2b37ad1814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7cdd23-57fa-4ae3-a104-e2b37ad1814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d812f3-50a6-4519-a5bf-aa511d749860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:18 devstack cinder-volume[82736]: DEBUG cinder.image.glance [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Creating Keystone auth plugin from conf {{(pid=82736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d812f3-50a6-4519-a5bf-aa511d749860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b8846b1-18a0-411f-9062-9adfa410586e', 'volume_name': 'volume-5b8846b1-18a0-411f-9062-9adfa410586e', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5be0869-a783-466c-97e8-0bf6eee46ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5be0869-a783-466c-97e8-0bf6eee46ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91a58df-b0ba-406d-b38d-45fd79f58225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:19 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Volume 5b8846b1-18a0-411f-9062-9adfa410586e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b8846b1-18a0-411f-9062-9adfa410586e', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Trying to clone 5b8846b1-18a0-411f-9062-9adfa410586e from image c37de8a8-6952-44d2-a609-d35b5a83220f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]). {{(pid=82736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 13 17:46:19 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645" returned: 0 in 0.697s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 17:46:19 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Image download 20.69 MB at 20.69 MB/s Apr 13 17:46:19 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 Apr 13 17:46:19 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e677c5a8-30e7-446e-b117-b9343f37866a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:19 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD Apr 13 17:46:19 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:19 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645" returned: 1 in 0.607s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:19 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645 Apr 13 17:46:19 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:19 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-79ca7377-6390-4d24-8912-e41fad520bb4 tempest-GroupSnapshotsTest-1545235004 None] Update group completed successfully. Apr 13 17:46:19 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:19 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Temporary image c37de8a8-6952-44d2-a609-d35b5a83220f is fetched for user 2f904be6fcb44289aa3ae08ec1779e09. {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd37dc6-c55c-4099-a382-eb073c9d3519]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:20 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD Apr 13 17:46:20 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:20 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-99db56b9-aff5-460b-879e-75c7ac58b645" returned: 0 in 0.487s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Lock "cinder-quobyte-99db56b9-aff5-460b-879e-75c7ac58b645" released by "delete_volume" :: held 1.838s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Created reservations ['48005b10-c2cc-45d7-8ae0-97f09082a8e4', '505d1677-20f1-4b4c-a686-2d232c1f1b84', '957b3059-c9fa-4984-b29b-77e6356c4db0', '14f07ad5-a7bb-4b71-8658-b6085f0969cb'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:20 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:20 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:20 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2075355843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8846b1-18a0-411f-9062-9adfa410586e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4c0ade4b043409cb82add54fbb970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:19Z,use_quota=True,user_id='2f904be6fcb44289aa3ae08ec1779e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Creating volume 5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:20 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:20 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e 1073741824 Apr 13 17:46:20 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:21 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.596s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:21 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Deleted volume successfully. Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c42e34dd-1506-4fa7-865f-2c9330577ad2 tempest-VolumesGetTest-1159801981 None] Lock "cinder-99db56b9-aff5-460b-879e-75c7ac58b645-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:21 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-06fcef77-0897-48a0-9da6-b5de30c648db tempest-GroupSnapshotsTest-1545235004 None] Update group completed successfully. Apr 13 17:46:21 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e 1073741824" returned: 0 in 0.698s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:21 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e Apr 13 17:46:21 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:21 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e" returned: 0 in 0.486s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Attempting download of c37de8a8-6952-44d2-a609-d35b5a83220f ((None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}])) to volume 5b8846b1-18a0-411f-9062-9adfa410586e. {{(pid=82736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b786b344-a1ed-4420-a1c3-971bc4d9d8de]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_j8tzq25b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:21 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_j8tzq25b Apr 13 17:46:21 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:22 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ebb342f2-0dfb-41dd-b298-1a1f55218bad tempest-GroupSnapshotsTest-1545235004 None] Update group completed successfully. Apr 13 17:46:22 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_j8tzq25b" returned: 0 in 0.555s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_j8tzq25b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:22 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_j8tzq25b Apr 13 17:46:22 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (b180f898-5f8f-4ffd-bd0b-d0d3a69efd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8742e38b-d896-4d58-9a36-ce4e62f28d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8742e38b-d896-4d58-9a36-ce4e62f28d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1569098194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0338d95-a16b-4a66-bceb-ed5828c2b2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:23Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94103a1f-1fdf-4117-9b30-344925f35416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94103a1f-1fdf-4117-9b30-344925f35416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cf9e52-ab22-44ec-85e2-cb20d7e6f975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cf9e52-ab22-44ec-85e2-cb20d7e6f975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0338d95-a16b-4a66-bceb-ed5828c2b2a8', 'volume_name': 'volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07af782b-a511-4086-8286-c56598c8e5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07af782b-a511-4086-8286-c56598c8e5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5a3693-2b91-456a-ac74-ab2c0b97732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:22 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Volume a0338d95-a16b-4a66-bceb-ed5828c2b2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8', 'volume_size': 1} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1569098194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0338d95-a16b-4a66-bceb-ed5828c2b2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:23Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Creating volume a0338d95-a16b-4a66-bceb-ed5828c2b2a8 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:22 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:22 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 1073741824 Apr 13 17:46:22 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (bb9eae03-0050-4776-9595-0cfbb98f4a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:22 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7eb8fe-d254-4e5e-9210-0e4d7857e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7eb8fe-d254-4e5e-9210-0e4d7857e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-679788994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014b2374-7488-4a51-b2a4-9242a06d277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:23Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363526af-9b7e-42f7-af2e-0829b541895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363526af-9b7e-42f7-af2e-0829b541895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e91eb7-76ac-4bc0-b94f-1943bf487dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e91eb7-76ac-4bc0-b94f-1943bf487dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '014b2374-7488-4a51-b2a4-9242a06d277b', 'volume_name': 'volume-014b2374-7488-4a51-b2a4-9242a06d277b', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15df5fd9-853f-4d87-8856-b6fea07723dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15df5fd9-853f-4d87-8856-b6fea07723dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be18154f-de1a-46c2-a12e-d44c762221ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Volume 014b2374-7488-4a51-b2a4-9242a06d277b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-014b2374-7488-4a51-b2a4-9242a06d277b', 'volume_size': 1} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:23 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_j8tzq25b" returned: 1 in 0.692s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_j8tzq25b' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7672688d-8fbf-430f-8141-5fc05b3e509b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:23 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD Apr 13 17:46:23 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (1eb21c81-68c0-4ad1-abe0-692a0c614835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fc95c1-0f57-4c61-aa5e-73af7a0f24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11fc95c1-0f57-4c61-aa5e-73af7a0f24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1839034143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f03e938-713e-4f80-92c8-fd08eac44b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:23Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba3f1a4-6136-4d5c-b1e0-d11b5d4e53c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba3f1a4-6136-4d5c-b1e0-d11b5d4e53c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e38d46-b04d-45bc-b38c-abe4ec412994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e38d46-b04d-45bc-b38c-abe4ec412994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f03e938-713e-4f80-92c8-fd08eac44b7d', 'volume_name': 'volume-3f03e938-713e-4f80-92c8-fd08eac44b7d', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92319d6-6b1d-4bd8-a67c-cf40e1bace2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92319d6-6b1d-4bd8-a67c-cf40e1bace2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c361f2-23bb-4948-923f-86db3eccd5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Volume 3f03e938-713e-4f80-92c8-fd08eac44b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f03e938-713e-4f80-92c8-fd08eac44b7d', 'volume_size': 1} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:23 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c253992d-510f-4bf4-ad8e-9ddd9b8439e4 tempest-GroupSnapshotsTest-1545235004 None] Update group completed successfully. Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (c3da4dac-05fa-4375-a75d-c93944ec03ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21d9768-ffb3-4f11-8995-0bd6ab8f1c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21d9768-ffb3-4f11-8995-0bd6ab8f1c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1188507308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a4e20f-9ada-4348-bde1-96886cd26868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:24Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d852c4c-470a-4d26-8f8a-41d23b72025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d852c4c-470a-4d26-8f8a-41d23b72025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6b009d-8342-4dc4-a5b4-23b5ee752534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6b009d-8342-4dc4-a5b4-23b5ee752534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a4e20f-9ada-4348-bde1-96886cd26868', 'volume_name': 'volume-83a4e20f-9ada-4348-bde1-96886cd26868', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b439c17-b389-4b8b-991a-7651fc4d084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b439c17-b389-4b8b-991a-7651fc4d084f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309c7464-12d4-4f7c-8f7b-5223d9f21e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Volume 83a4e20f-9ada-4348-bde1-96886cd26868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a4e20f-9ada-4348-bde1-96886cd26868', 'volume_size': 1} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 1073741824" returned: 0 in 0.804s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:23 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 Apr 13 17:46:23 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (e1c5cf29-5565-4a5d-afcb-cf23a03e3e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825c583f-f216-4dbf-8a3a-98c874f344cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825c583f-f216-4dbf-8a3a-98c874f344cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-59063232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96383a96-adfa-4e94-9ac3-3def6a28647e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:24Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256e0407-4903-4043-9caa-e8e56ea3083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256e0407-4903-4043-9caa-e8e56ea3083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ebcf74-9144-4a52-92bd-1e86b1ce295b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ebcf74-9144-4a52-92bd-1e86b1ce295b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96383a96-adfa-4e94-9ac3-3def6a28647e', 'volume_name': 'volume-96383a96-adfa-4e94-9ac3-3def6a28647e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1d3463-5f3b-4df3-8fac-4872e2bb08cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1d3463-5f3b-4df3-8fac-4872e2bb08cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121387cc-1b95-4513-b3e2-b11972133752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:23 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Volume 96383a96-adfa-4e94-9ac3-3def6a28647e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96383a96-adfa-4e94-9ac3-3def6a28647e', 'volume_size': 1} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:23 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] c37de8a8-6952-44d2-a609-d35b5a83220f was qcow2, converting to raw {{(pid=82736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 17:46:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:23 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e Apr 13 17:46:23 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:24 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8" returned: 0 in 0.469s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-679788994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014b2374-7488-4a51-b2a4-9242a06d277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:23Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Creating volume 014b2374-7488-4a51-b2a4-9242a06d277b {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:24 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5a3693-2b91-456a-ac74-ab2c0b97732c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2e59a8-543f-481e-994d-042b8e49b56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:24 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Volume volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 (a0338d95-a16b-4a66-bceb-ed5828c2b2a8): created successfully Apr 13 17:46:24 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b 1073741824 Apr 13 17:46:24 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2e59a8-543f-481e-994d-042b8e49b56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (b180f898-5f8f-4ffd-bd0b-d0d3a69efd12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:24 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-78f06450-d60d-40aa-8cf0-e981b2d5be35 tempest-CreateVolumesFromImageTest-2042646289 None] Created volume successfully. Apr 13 17:46:24 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] GroupSnapshot b0638bda-11d9-4e18-8b0b-5abcb7773c63: creating. Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Group snapshot b0638bda-11d9-4e18-8b0b-5abcb7773c63: creating. {{(pid=82736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:24 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b 1073741824" returned: 0 in 0.730s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:24 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b Apr 13 17:46:24 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:24 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e" returned: 0 in 1.084s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_kuf3ttgmdevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:46:24 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Converted 112.00 MB image at 103.10 MB/s Apr 13 17:46:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:25 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e 1G Apr 13 17:46:25 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:25 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b" returned: 0 in 0.454s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.068s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1839034143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f03e938-713e-4f80-92c8-fd08eac44b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:23Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Creating volume 3f03e938-713e-4f80-92c8-fd08eac44b7d {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:25 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be18154f-de1a-46c2-a12e-d44c762221ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014b2374-7488-4a51-b2a4-9242a06d277b', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e27a4a0-eaf6-4832-9cff-f0e3357c0da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:25 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d 1073741824 Apr 13 17:46:25 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:25 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Volume volume-014b2374-7488-4a51-b2a4-9242a06d277b (014b2374-7488-4a51-b2a4-9242a06d277b): created successfully Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e27a4a0-eaf6-4832-9cff-f0e3357c0da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (bb9eae03-0050-4776-9595-0cfbb98f4a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:25 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4286586c-f4a2-4feb-b190-71248595ce7a tempest-CreateVolumesFromImageTest-2042646289 None] Created volume successfully. Apr 13 17:46:25 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e 1G" returned: 0 in 0.544s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e112f5e-66d2-4d48-94d0-f1eb925a0bd4]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:25 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e Apr 13 17:46:25 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:25 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d 1073741824" returned: 0 in 0.597s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:26 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d Apr 13 17:46:26 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:26 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e" returned: 0 in 0.577s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:26 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e Apr 13 17:46:26 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:26 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d" returned: 0 in 0.436s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.825s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1188507308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a4e20f-9ada-4348-bde1-96886cd26868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:24Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Creating volume 83a4e20f-9ada-4348-bde1-96886cd26868 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:26 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:26 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 1073741824 Apr 13 17:46:26 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c361f2-23bb-4948-923f-86db3eccd5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f03e938-713e-4f80-92c8-fd08eac44b7d', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f0718c-bca9-4f2a-9bde-5d3b3310af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:26 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Volume volume-3f03e938-713e-4f80-92c8-fd08eac44b7d (3f03e938-713e-4f80-92c8-fd08eac44b7d): created successfully Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f0718c-bca9-4f2a-9bde-5d3b3310af61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (1eb21c81-68c0-4ad1-abe0-692a0c614835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-30e2713b-9d9f-41b5-93dd-9449348e4925 tempest-CreateVolumesFromImageTest-2042646289 None] Created volume successfully. Apr 13 17:46:26 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e" returned: 1 in 0.562s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Downloaded image c37de8a8-6952-44d2-a609-d35b5a83220f ((None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}])) to volume 5b8846b1-18a0-411f-9062-9adfa410586e successfully. {{(pid=82736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Temporary image c37de8a8-6952-44d2-a609-d35b5a83220f for user 2f904be6fcb44289aa3ae08ec1779e09 is deleted. {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Marking volume 5b8846b1-18a0-411f-9062-9adfa410586e as bootable. {{(pid=82736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Copying metadata from image c37de8a8-6952-44d2-a609-d35b5a83220f to 5b8846b1-18a0-411f-9062-9adfa410586e. {{(pid=82736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Creating volume glance metadata for volume 5b8846b1-18a0-411f-9062-9adfa410586e backed by image c37de8a8-6952-44d2-a609-d35b5a83220f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91a58df-b0ba-406d-b38d-45fd79f58225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8846b1-18a0-411f-9062-9adfa410586e', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d53570-9868-4bbc-b790-fcd4b55c1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:26 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Volume volume-5b8846b1-18a0-411f-9062-9adfa410586e (5b8846b1-18a0-411f-9062-9adfa410586e): created successfully Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d53570-9868-4bbc-b790-fcd4b55c1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Flow 'volume_create_manager' (d4dcd93c-e1ee-401c-a73c-36519f02dae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5d55bf1a-2bef-43d9-bab0-81b067d5d141 tempest-VolumesImageMetadata-1976904618 None] Created volume successfully. Apr 13 17:46:27 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 1073741824" returned: 0 in 0.568s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:UPDATE=251,cinder:DELETE=24,cinder:SELECT=227,cinder:INSERT=83 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:27 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 Apr 13 17:46:27 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:27 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868" returned: 0 in 0.447s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.694s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-59063232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96383a96-adfa-4e94-9ac3-3def6a28647e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bf3a370f5a4f64ad6c49320ebebb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:24Z,use_quota=True,user_id='a05168fdc1aa42e99ca3148887c22560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Creating volume 96383a96-adfa-4e94-9ac3-3def6a28647e {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:27 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:27 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e 1073741824 Apr 13 17:46:27 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309c7464-12d4-4f7c-8f7b-5223d9f21e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a4e20f-9ada-4348-bde1-96886cd26868', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae09f23-3537-4f45-955e-3c8bca64a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:27 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Volume volume-83a4e20f-9ada-4348-bde1-96886cd26868 (83a4e20f-9ada-4348-bde1-96886cd26868): created successfully Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae09f23-3537-4f45-955e-3c8bca64a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (c3da4dac-05fa-4375-a75d-c93944ec03ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Flow 'volume_create_manager' (89423be8-05d7-4dc4-88ef-fef9cec79d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec6fb65-b466-4bbd-80e9-80efac7d49bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:27 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-34872519-55c6-4ddb-acf1-c54415b9eb5d tempest-CreateVolumesFromImageTest-2042646289 None] Created volume successfully. Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec6fb65-b466-4bbd-80e9-80efac7d49bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1245530598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5328a00-472f-47a1-86b5-20bc3ede2eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6aa4459544d4f628e1a640d5199c1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:28Z,use_quota=True,user_id='aa813fbfaf94485bbce2f41ab3493b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274dd006-3095-41d2-8ef7-30c47fc83800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274dd006-3095-41d2-8ef7-30c47fc83800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6688969-75a2-4250-acb1-91eeda7f4403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6688969-75a2-4250-acb1-91eeda7f4403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5328a00-472f-47a1-86b5-20bc3ede2eb8', 'volume_name': 'volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f46c5b-afdc-4ca5-8d27-1dc6eb8fc06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f46c5b-afdc-4ca5-8d27-1dc6eb8fc06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de46ac4b-bab2-4f9b-b0d9-4db92680e68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:27 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Volume f5328a00-472f-47a1-86b5-20bc3ede2eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8', 'volume_size': 1} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Acquiring lock "cinder-5b8846b1-18a0-411f-9062-9adfa410586e-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Lock "cinder-5b8846b1-18a0-411f-9062-9adfa410586e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Acquiring lock "cinder-quobyte-5b8846b1-18a0-411f-9062-9adfa410586e" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Lock "cinder-quobyte-5b8846b1-18a0-411f-9062-9adfa410586e" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f3ecfc-6b77-4fae-b112-3ad75ab52502]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:27 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e Apr 13 17:46:27 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:28 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e 1073741824" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:28 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e Apr 13 17:46:28 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:28 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e" returned: 0 in 0.539s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:28 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e Apr 13 17:46:28 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:28 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e" returned: 0 in 0.406s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.636s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121387cc-1b95-4513-b3e2-b11972133752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96383a96-adfa-4e94-9ac3-3def6a28647e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecb548d-a542-418f-9fd0-03e517cd2fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Creating offline snapshot 44d76d46-0941-4469-a49e-70e702196013 of volume f0f4decd-1c7b-4319-84d1-ff605d310ecb {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca75bd4-4d3c-42a1-bd5d-61d7bcf9ec79]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:28 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Volume volume-96383a96-adfa-4e94-9ac3-3def6a28647e (96383a96-adfa-4e94-9ac3-3def6a28647e): created successfully Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecb548d-a542-418f-9fd0-03e517cd2fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Flow 'volume_create_manager' (e1c5cf29-5565-4a5d-afcb-cf23a03e3e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:28 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-910f4cb0-a25a-4a24-a2bf-837b8775d3cb tempest-CreateVolumesFromImageTest-2042646289 None] Created volume successfully. Apr 13 17:46:28 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb Apr 13 17:46:28 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:28 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e" returned: 1 in 0.478s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:28 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e Apr 13 17:46:28 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:28 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb" returned: 0 in 0.480s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:28 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 1G Apr 13 17:46:28 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-96383a96-adfa-4e94-9ac3-3def6a28647e-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-96383a96-adfa-4e94-9ac3-3def6a28647e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:29 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-quobyte-96383a96-adfa-4e94-9ac3-3def6a28647e" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b8846b1-18a0-411f-9062-9adfa410586e" returned: 0 in 0.426s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Lock "cinder-quobyte-5b8846b1-18a0-411f-9062-9adfa410586e" released by "delete_volume" :: held 1.483s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-96383a96-adfa-4e94-9ac3-3def6a28647e" acquired by "delete_volume" :: waited 0.017s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[71042dec-85f6-4c76-b1dc-d2cac5724a93]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Created reservations ['527e739e-7d95-411e-b0d4-f9aad1b54910', '33d2546f-f1cb-4125-aadc-13daeb096d44', '9f0623ad-a000-4d9b-afc9-79e7030009e0', 'ea80e2ea-91e9-47c9-90bf-b9a5cb019fcf'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:29 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e Apr 13 17:46:29 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:29 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:29 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:29 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 1G" returned: 0 in 0.518s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:29 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 Apr 13 17:46:29 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:29 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:29 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e" returned: 0 in 0.506s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.442s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:29 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Deleted volume successfully. Apr 13 17:46:29 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e Apr 13 17:46:29 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5c2d08e3-e57d-4e41-af08-448726e97849 tempest-VolumesImageMetadata-1976904618 None] Lock "cinder-5b8846b1-18a0-411f-9062-9adfa410586e-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:29 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013" returned: 0 in 0.505s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:29 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:46:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:30 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 Apr 13 17:46:30 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:30 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96383a96-adfa-4e94-9ac3-3def6a28647e" returned: 0 in 0.481s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-96383a96-adfa-4e94-9ac3-3def6a28647e" released by "delete_volume" :: held 1.024s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Created reservations ['76e20c01-10ce-4a42-85e3-2a00e6a36082', 'b1038496-e2b1-402b-b7b2-4d11d42ae2a2', '2918cafb-2207-437d-93f7-b141aa644579', 'b5c05cf5-7a4e-4cc4-950a-c44c5136f2bb'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:30 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:30 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:30 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013" returned: 0 in 0.535s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:30 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.info Apr 13 17:46:30 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:30 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.498s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:30 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Deleted volume successfully. Apr 13 17:46:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4c9550f0-8563-4b06-b3df-e41bc57ea3e7 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-96383a96-adfa-4e94-9ac3-3def6a28647e-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:31 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.info" returned: 0 in 0.464s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:31 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:31 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.info Apr 13 17:46:31 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-83a4e20f-9ada-4348-bde1-96886cd26868-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-83a4e20f-9ada-4348-bde1-96886cd26868-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-quobyte-83a4e20f-9ada-4348-bde1-96886cd26868" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-83a4e20f-9ada-4348-bde1-96886cd26868" acquired by "delete_volume" :: waited 0.020s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99162b1-bc3d-4947-9053-bbeae344c880]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:31 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.info" returned: 0 in 0.448s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.018s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Creating offline snapshot a03147cc-9bfe-4ba1-8507-878d81ff9a7c of volume 3f739c4f-792d-4271-81e4-e9718af8f99a {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[316cbfca-eb92-4dbc-8e4a-2ecd5537bcbc]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:31 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 Apr 13 17:46:31 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:31 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a Apr 13 17:46:31 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Flow 'volume_create_manager' (6ebf2d40-d794-488d-a4fb-817da94083e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30d10c6-96d3-4beb-8ece-654fd5f91db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30d10c6-96d3-4beb-8ece-654fd5f91db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1856801196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f8e4c8-fb1e-49ca-80bc-8f699239338f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02b0be02de724359911ac9ca413aac65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:32Z,use_quota=True,user_id='5d541609542842128d0a250be720b855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304f0982-c47f-48d3-9e0a-e4429a8dece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304f0982-c47f-48d3-9e0a-e4429a8dece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5758bcb7-d6c0-4643-a2e7-47e84c4fbbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5758bcb7-d6c0-4643-a2e7-47e84c4fbbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f8e4c8-fb1e-49ca-80bc-8f699239338f', 'volume_name': 'volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9646f3-4730-47ce-80c0-4fa433da0d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9646f3-4730-47ce-80c0-4fa433da0d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea47ebb-9edd-47a0-a192-23cddcf06021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:31 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Volume b5f8e4c8-fb1e-49ca-80bc-8f699239338f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f', 'volume_size': 1} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:31 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868" returned: 0 in 0.529s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:31 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868 Apr 13 17:46:31 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:32 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a" returned: 0 in 0.570s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:32 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c 1G Apr 13 17:46:32 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:32 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-83a4e20f-9ada-4348-bde1-96886cd26868" returned: 0 in 0.413s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-83a4e20f-9ada-4348-bde1-96886cd26868" released by "delete_volume" :: held 0.967s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Created reservations ['d2d31d76-2211-45e4-ba02-7b439217122c', 'a3d59cc8-5149-4e54-be3e-90c5725aaf42', 'd27d72ab-16c2-4c35-8353-250a41ff1aa3', 'afdf5b55-858f-48f7-8c2a-c0f82f177457'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:32 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:32 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:32 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c 1G" returned: 0 in 0.510s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f739c4f-792d-4271-81e4-e9718af8f99a -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:32 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f739c4f-792d-4271-81e4-e9718af8f99a -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c Apr 13 17:46:32 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:32 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.474s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:32 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Deleted volume successfully. Apr 13 17:46:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54d6a194-65df-483a-b227-2aa7170e186d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-83a4e20f-9ada-4348-bde1-96886cd26868-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:33 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f739c4f-792d-4271-81e4-e9718af8f99a -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c" returned: 0 in 0.424s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:33 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:33 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c Apr 13 17:46:33 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:33 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c" returned: 0 in 0.429s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:33 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.info Apr 13 17:46:33 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-3f03e938-713e-4f80-92c8-fd08eac44b7d-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-3f03e938-713e-4f80-92c8-fd08eac44b7d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-quobyte-3f03e938-713e-4f80-92c8-fd08eac44b7d" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-3f03e938-713e-4f80-92c8-fd08eac44b7d" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cad56b3-e8d0-4ad2-8ee0-9aa4ac8b01be]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:33 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d Apr 13 17:46:33 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:33 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.info" returned: 0 in 0.417s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:33 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:46:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:33 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.info Apr 13 17:46:33 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:34 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d" returned: 0 in 0.495s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:34 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d Apr 13 17:46:34 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:34 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.info" returned: 0 in 0.434s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.646s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1245530598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5328a00-472f-47a1-86b5-20bc3ede2eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6aa4459544d4f628e1a640d5199c1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:28Z,use_quota=True,user_id='aa813fbfaf94485bbce2f41ab3493b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Creating volume f5328a00-472f-47a1-86b5-20bc3ede2eb8 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:34 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:34 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 1073741824 Apr 13 17:46:34 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:34 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-18e7de55-b2e9-4683-9df3-7bee38a99f01 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot b0638bda-11d9-4e18-8b0b-5abcb7773c63: created successfully Apr 13 17:46:34 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f03e938-713e-4f80-92c8-fd08eac44b7d" returned: 0 in 0.418s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-3f03e938-713e-4f80-92c8-fd08eac44b7d" released by "delete_volume" :: held 0.936s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Created reservations ['b11aa7ef-50b4-452f-bc68-81499f717402', '709f1312-ae11-4d06-9ad1-8b9f186478a1', 'e0d67c70-bf5e-4744-b191-882b9e5605af', 'c652546b-f09b-4a54-b735-9a8ae97b96bf'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:34 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:34 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-014b2374-7488-4a51-b2a4-9242a06d277b-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-014b2374-7488-4a51-b2a4-9242a06d277b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-quobyte-014b2374-7488-4a51-b2a4-9242a06d277b" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-014b2374-7488-4a51-b2a4-9242a06d277b" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[57730905-cbb2-43b9-b8b4-dcb913fdd64d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:34 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b Apr 13 17:46:34 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:34 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 1073741824" returned: 0 in 0.515s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:34 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 Apr 13 17:46:34 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:35 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.452s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Deleted volume successfully. Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54b35040-908f-4c99-adf1-eaaa7755f28d tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-3f03e938-713e-4f80-92c8-fd08eac44b7d-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot b0638bda-11d9-4e18-8b0b-5abcb7773c63: deleting Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot b0638bda-11d9-4e18-8b0b-5abcb7773c63: deleting {{(pid=82736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-f0f4decd-1c7b-4319-84d1-ff605d310ecb" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-f0f4decd-1c7b-4319-84d1-ff605d310ecb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-44d76d46-0941-4469-a49e-70e702196013" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-44d76d46-0941-4469-a49e-70e702196013" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Deleting offline snapshot 44d76d46-0941-4469-a49e-70e702196013 of volume f0f4decd-1c7b-4319-84d1-ff605d310ecb {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] snapshot_file for this snap is: volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cf5434-8fb3-4c9a-a726-4a7a7d07b0e3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:35 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b" returned: 0 in 0.607s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:35 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b Apr 13 17:46:35 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:35 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 Apr 13 17:46:35 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:35 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8" returned: 0 in 0.536s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.535s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1856801196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f8e4c8-fb1e-49ca-80bc-8f699239338f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02b0be02de724359911ac9ca413aac65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:32Z,use_quota=True,user_id='5d541609542842128d0a250be720b855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Creating volume b5f8e4c8-fb1e-49ca-80bc-8f699239338f {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:35 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de46ac4b-bab2-4f9b-b0d9-4db92680e68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:35 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f 1073741824 Apr 13 17:46:35 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96132bf0-65a2-43ba-a680-a03fc9ca26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:35 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Volume volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 (f5328a00-472f-47a1-86b5-20bc3ede2eb8): created successfully Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96132bf0-65a2-43ba-a680-a03fc9ca26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Flow 'volume_create_manager' (89423be8-05d7-4dc4-88ef-fef9cec79d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e9b78fc2-1e86-457d-bea9-5d66c9b1dc68 tempest-VolumesTransfersV355Test-1979775440 None] Created volume successfully. Apr 13 17:46:35 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-014b2374-7488-4a51-b2a4-9242a06d277b" returned: 0 in 0.519s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-014b2374-7488-4a51-b2a4-9242a06d277b" released by "delete_volume" :: held 1.148s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=217,cinder:INSERT=67,cinder:UPDATE=274,cinder:DELETE=18 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:46:35 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013" returned: 0 in 0.613s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Created reservations ['ceeba9ff-6a05-4ff4-856f-4a1c42d783d9', '9647a4d0-1f4c-401e-b792-513044d4762a', '005fd3ac-c209-4781-a656-e200cee52899', '01d0808e-5c77-4e94-9b56-f3c0919dc127'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fb993c-5109-4771-8d6f-a8917667777b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:36 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f 1073741824" returned: 0 in 0.603s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:36 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:36 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb Apr 13 17:46:36 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:36 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:36 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f Apr 13 17:46:36 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:36 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:36 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d5407954-c52d-4778-9321-467a76a011c8 tempest-VolumesTransfersV355Test-720566260 None] Transfer volume completed successfully. Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" returned: 0 in 0.467s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea47ebb-9edd-47a0-a192-23cddcf06021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:36 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0b9c55-1436-4fee-b0d3-f1252323ef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.539s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:36 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Volume volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f (b5f8e4c8-fb1e-49ca-80bc-8f699239338f): created successfully Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0b9c55-1436-4fee-b0d3-f1252323ef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Flow 'volume_create_manager' (6ebf2d40-d794-488d-a4fb-817da94083e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:36 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Deleted volume successfully. Apr 13 17:46:36 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-7a3a69e4-d9b3-4bbe-bb9d-38f2c47f2ea9 tempest-SnapshotMetadataTestJSON-1280484606 None] Created volume successfully. Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a15f56ad-1e98-42f6-9d1e-06ed4fcadb8b tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-014b2374-7488-4a51-b2a4-9242a06d277b-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:36 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb" returned: 0 in 0.641s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:36 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 Apr 13 17:46:36 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-a0338d95-a16b-4a66-bceb-ed5828c2b2a8-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-a0338d95-a16b-4a66-bceb-ed5828c2b2a8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "cinder-quobyte-a0338d95-a16b-4a66-bceb-ed5828c2b2a8" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-a0338d95-a16b-4a66-bceb-ed5828c2b2a8" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0977f95b-c996-400f-82c7-ddada2338c92]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:37 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 Apr 13 17:46:37 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:37 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013" returned: 0 in 0.581s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:37 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013 Apr 13 17:46:37 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Creating offline snapshot 0118472d-a8a7-4ddb-8341-f41d4ec75f18 of volume b5f8e4c8-fb1e-49ca-80bc-8f699239338f {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ca32f-2e4e-4065-bbff-13d7f62e2f72]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Acquiring lock "cinder-f5328a00-472f-47a1-86b5-20bc3ede2eb8-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:37 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f Apr 13 17:46:37 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Lock "cinder-f5328a00-472f-47a1-86b5-20bc3ede2eb8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Acquiring lock "cinder-quobyte-f5328a00-472f-47a1-86b5-20bc3ede2eb8" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Lock "cinder-quobyte-f5328a00-472f-47a1-86b5-20bc3ede2eb8" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[95117d88-bdb6-45ee-adc9-1aaed5406a0a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:37 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8" returned: 0 in 0.619s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:37 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8 Apr 13 17:46:37 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:37 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 Apr 13 17:46:37 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:37 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb.44d76d46-0941-4469-a49e-70e702196013" returned: 0 in 0.552s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-44d76d46-0941-4469-a49e-70e702196013" released by "_delete_snapshot" :: held 2.450s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-f0f4decd-1c7b-4319-84d1-ff605d310ecb" released by "delete_snapshot" :: held 2.468s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-3f739c4f-792d-4271-81e4-e9718af8f99a" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-3f739c4f-792d-4271-81e4-e9718af8f99a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-a03147cc-9bfe-4ba1-8507-878d81ff9a7c" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-a03147cc-9bfe-4ba1-8507-878d81ff9a7c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Deleting offline snapshot a03147cc-9bfe-4ba1-8507-878d81ff9a7c of volume 3f739c4f-792d-4271-81e4-e9718af8f99a {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] snapshot_file for this snap is: volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[862fa208-50d6-463c-8600-82c3cb095fcf]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:37 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c Apr 13 17:46:37 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:37 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" returned: 0 in 0.556s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:37 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 1G Apr 13 17:46:37 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:38 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8" returned: 0 in 0.498s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:38 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0338d95-a16b-4a66-bceb-ed5828c2b2a8" returned: 0 in 0.478s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-quobyte-a0338d95-a16b-4a66-bceb-ed5828c2b2a8" released by "delete_volume" :: held 1.130s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:38 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8 Apr 13 17:46:38 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Created reservations ['3b3e1207-4da2-45db-845e-afb416f4aa6d', '292ea684-cd3a-480b-9521-a63190d8632b', '512b2554-ced0-4949-a65c-9e1544e267d1', 'cfaf2a80-ba9c-4bce-b2c9-806006d9b454'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:38 devstack sudo[87377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:38 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:38 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c" returned: 0 in 0.578s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f739c4f-792d-4271-81e4-e9718af8f99a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd45aeb-07c6-49fc-bcae-0f57eb07db8f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:38 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 1G" returned: 0 in 0.563s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:38 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 Apr 13 17:46:38 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:38 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a Apr 13 17:46:38 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:38 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f5328a00-472f-47a1-86b5-20bc3ede2eb8" returned: 0 in 0.506s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Lock "cinder-quobyte-f5328a00-472f-47a1-86b5-20bc3ede2eb8" released by "delete_volume" :: held 1.040s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Created reservations ['87b19df8-4d27-4fc1-9ca5-5709a7a84599', '2ee3eb2d-005f-4ddf-b92f-883358e197b9', 'cfaf6b1d-fce3-4e08-bcd2-710b08cd7be7', 'a9e79703-48a8-41dc-b1dc-615321a54d3b'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:38 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:38 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:38 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.536s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Deleted volume successfully. Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-bcd394eb-648f-4d6d-aff3-ed3eeca5d043 tempest-CreateVolumesFromImageTest-2042646289 None] Lock "cinder-a0338d95-a16b-4a66-bceb-ed5828c2b2a8-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:38 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a" returned: 0 in 0.573s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:39 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18" returned: 0 in 0.537s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:39 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 is being set with open permissions: ugo+rw Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:39 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c Apr 13 17:46:39 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:39 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 Apr 13 17:46:39 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:39 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.455s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:39 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Deleted volume successfully. Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2bf2aeee-ce43-4d0a-92b8-b8ae8a5aa79e tempest-VolumesTransfersV355Test-595357096 None] Lock "cinder-f5328a00-472f-47a1-86b5-20bc3ede2eb8-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:39 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c" returned: 0 in 0.491s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:39 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c Apr 13 17:46:39 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:39 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18" returned: 0 in 0.558s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:39 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.info Apr 13 17:46:39 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:39 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a.a03147cc-9bfe-4ba1-8507-878d81ff9a7c" returned: 0 in 0.494s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-a03147cc-9bfe-4ba1-8507-878d81ff9a7c" released by "_delete_snapshot" :: held 2.210s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-3f739c4f-792d-4271-81e4-e9718af8f99a" released by "delete_snapshot" :: held 2.228s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:40 devstack cinder-volume[82736]: WARNING cinder.quota [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-473032934 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-473032934, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:46:40 devstack cinder-volume[82736]: WARNING cinder.quota [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-473032934 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-473032934, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['7901d0f2-e4d7-4829-b2d2-5dc0926e73f8', '08c6e74a-1435-4416-966d-22e7c4a9d061', '79173836-1170-4323-bf70-de040873f388', 'd627d8e5-643e-42e6-aacf-05df54995fa0'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Flow 'volume_create_manager' (80a749f9-11eb-4fdf-a79c-87a812384eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396c409d-90cf-4e34-b3d6-376b92fc3620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396c409d-90cf-4e34-b3d6-376b92fc3620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1616890281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf47dfeb-baea-4dee-a58a-db096d2629f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6aa4459544d4f628e1a640d5199c1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:40Z,use_quota=True,user_id='aa813fbfaf94485bbce2f41ab3493b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e38a724-9fa2-4e1c-aac6-22bcafde32fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e38a724-9fa2-4e1c-aac6-22bcafde32fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:40 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b154630-b08c-488b-8b91-1e649dc0ef2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b154630-b08c-488b-8b91-1e649dc0ef2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf47dfeb-baea-4dee-a58a-db096d2629f4', 'volume_name': 'volume-bf47dfeb-baea-4dee-a58a-db096d2629f4', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b81032-4081-4f6e-8aee-2e7011fc5799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b81032-4081-4f6e-8aee-2e7011fc5799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b6ed85-c007-4e85-a956-666d9b9537a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:40 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Volume bf47dfeb-baea-4dee-a58a-db096d2629f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf47dfeb-baea-4dee-a58a-db096d2629f4', 'volume_size': 1} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['ced02443-31d9-4471-b04e-a50824da8d5c', 'e52a95b3-f04a-4dba-a337-c5575e0b3490', '24633e09-239b-420a-8715-36761f5f83c5', '9cf947a4-2efa-4525-9679-e925889aa8bf'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.info" returned: 0 in 0.646s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:40 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.info is being set with open permissions: ugo+rw Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:40 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.info Apr 13 17:46:40 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:40 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f2925d3f-6d10-42b8-9d35-cf046b96d1b6 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot b0638bda-11d9-4e18-8b0b-5abcb7773c63: deleted successfully Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-3f739c4f-792d-4271-81e4-e9718af8f99a" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:40 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-3f739c4f-792d-4271-81e4-e9718af8f99a" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.info" returned: 0 in 0.601s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.529s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4da7cd-1453-4cc4-88b5-d4588c0f0ab6]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1616890281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf47dfeb-baea-4dee-a58a-db096d2629f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6aa4459544d4f628e1a640d5199c1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:40Z,use_quota=True,user_id='aa813fbfaf94485bbce2f41ab3493b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Creating volume bf47dfeb-baea-4dee-a58a-db096d2629f4 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:40 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:40 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 1073741824 Apr 13 17:46:40 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:40 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-42942b63-4b85-4f98-9f00-e2a5980b005f tempest-SnapshotMetadataTestJSON-1280484606 None] Create snapshot completed successfully Apr 13 17:46:40 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a Apr 13 17:46:40 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Flow 'volume_create_manager' (b0345564-80bc-4049-a95d-0a63d838bc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18600e31-1330-46f6-b8da-76f76d74aaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18600e31-1330-46f6-b8da-76f76d74aaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-590343655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14d4ccd-a3a8-4ae0-9288-e2d3b446c054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ad62cf47a744d999e3af14d2945a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:41Z,use_quota=True,user_id='4a3c5db6390949c38712a9524df4f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f03fbe-9ac3-4369-b764-a2d48e104e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f03fbe-9ac3-4369-b764-a2d48e104e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6e3b52-878d-4ea3-a360-fba4cb592433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6e3b52-878d-4ea3-a360-fba4cb592433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd14d4ccd-a3a8-4ae0-9288-e2d3b446c054', 'volume_name': 'volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef59e773-6e26-4cb6-8607-0079505cc38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef59e773-6e26-4cb6-8607-0079505cc38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ba06db-6c7d-4b56-ba9a-27a908beb684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:41 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Volume d14d4ccd-a3a8-4ae0-9288-e2d3b446c054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054', 'volume_size': 1} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:41 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a" returned: 0 in 0.543s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:41 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a Apr 13 17:46:41 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:41 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 1073741824" returned: 0 in 0.589s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:41 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 Apr 13 17:46:41 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "cinder-0118472d-a8a7-4ddb-8341-f41d4ec75f18-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-0118472d-a8a7-4ddb-8341-f41d4ec75f18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "cinder-quobyte-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-quobyte-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "cinder-quobyte-0118472d-a8a7-4ddb-8341-f41d4ec75f18" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:41 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3f739c4f-792d-4271-81e4-e9718af8f99a" returned: 0 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-quobyte-0118472d-a8a7-4ddb-8341-f41d4ec75f18" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Deleting offline snapshot 0118472d-a8a7-4ddb-8341-f41d4ec75f18 of volume b5f8e4c8-fb1e-49ca-80bc-8f699239338f {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:46:41 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] snapshot_file for this snap is: volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4" returned: 0 in 0.500s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-3f739c4f-792d-4271-81e4-e9718af8f99a" released by "delete_volume" :: held 1.166s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-f0f4decd-1c7b-4319-84d1-ff605d310ecb" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f03c41a-17ca-47de-af28-a0e51dcb068b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-590343655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14d4ccd-a3a8-4ae0-9288-e2d3b446c054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ad62cf47a744d999e3af14d2945a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:41Z,use_quota=True,user_id='4a3c5db6390949c38712a9524df4f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Creating volume d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:42 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:42 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 1073741824 Apr 13 17:46:42 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b6ed85-c007-4e85-a956-666d9b9537a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf47dfeb-baea-4dee-a58a-db096d2629f4', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca283c22-7114-4b26-bef2-51fa9c81d9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-f0f4decd-1c7b-4319-84d1-ff605d310ecb" acquired by "delete_volume" :: waited 0.058s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[608c7670-23f0-4262-b6aa-a5b20129f545]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:42 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Volume volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 (bf47dfeb-baea-4dee-a58a-db096d2629f4): created successfully Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca283c22-7114-4b26-bef2-51fa9c81d9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Flow 'volume_create_manager' (80a749f9-11eb-4fdf-a79c-87a812384eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:42 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ade15906-c45a-4888-83e8-a72044b0134a tempest-VolumesTransfersV355Test-1979775440 None] Created volume successfully. Apr 13 17:46:42 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 Apr 13 17:46:42 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:42 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb Apr 13 17:46:42 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Acquiring lock "cinder-bf47dfeb-baea-4dee-a58a-db096d2629f4-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Lock "cinder-bf47dfeb-baea-4dee-a58a-db096d2629f4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Acquiring lock "cinder-quobyte-bf47dfeb-baea-4dee-a58a-db096d2629f4" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Lock "cinder-quobyte-bf47dfeb-baea-4dee-a58a-db096d2629f4" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[db66de6b-cfad-4776-a0c6-750424be5f6c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:42 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 Apr 13 17:46:42 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:42 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 1073741824" returned: 0 in 0.642s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:42 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18" returned: 0 in 0.638s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[25229b77-a41a-419e-b3c4-2d63986448b8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:42 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb" returned: 0 in 0.612s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:42 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb Apr 13 17:46:42 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:42 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 Apr 13 17:46:42 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:42 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f Apr 13 17:46:42 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:43 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4" returned: 0 in 0.509s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:43 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4 Apr 13 17:46:43 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:43 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f0f4decd-1c7b-4319-84d1-ff605d310ecb" returned: 0 in 0.466s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-f0f4decd-1c7b-4319-84d1-ff605d310ecb" released by "delete_volume" :: held 1.113s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:43 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" returned: 0 in 0.491s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ba06db-6c7d-4b56-ba9a-27a908beb684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b65418c-3de0-41c4-a8ca-eb79b0dcb14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:43 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Volume volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 (d14d4ccd-a3a8-4ae0-9288-e2d3b446c054): created successfully Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b65418c-3de0-41c4-a8ca-eb79b0dcb14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Flow 'volume_create_manager' (b0345564-80bc-4049-a95d-0a63d838bc1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:43 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-bd1c6f31-5eaf-429b-906a-d46d02c1b662 tempest-VolumeDependencyTests-461253640 None] Created volume successfully. Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['f73187e0-9b99-4451-857f-a48be388fe3e'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:43 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" returned: 0 in 0.581s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:43 devstack cinder-volume[82736]: WARNING cinder.quota [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-473032934 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-473032934, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:46:43 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 Apr 13 17:46:43 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['90052862-4033-4dfd-9b6b-b55594876a90', '5502a77f-870a-419f-8159-58bb145346c4', '29e078d5-2a00-4350-90ad-1e2168b26f0a', '88919a43-3c4c-4645-b817-ae4232ad6566'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['a8f3fbcd-46ea-4041-8c83-27f05ae5783e', 'da6d45d7-5e05-4adb-9b44-73547bce28ec', '5c90e419-5b24-45fa-8032-9a53586e396e', '82132740-c05c-42d5-9ae0-923d1db371e3'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:43 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:43 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:43 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bf47dfeb-baea-4dee-a58a-db096d2629f4" returned: 0 in 0.442s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Lock "cinder-quobyte-bf47dfeb-baea-4dee-a58a-db096d2629f4" released by "delete_volume" :: held 0.979s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Created reservations ['d5ff36b3-2780-4ded-b41b-ab30f839cfed', '545ed983-dd39-43a8-ab2c-93cda4bd4d08', 'c5d9bc11-5770-4db8-bb3c-335a99cf7c04', '3df03820-57d1-40c2-80e7-8dd11c5c96d1'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:43 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:43 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:43 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18" returned: 0 in 0.521s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:43 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18 Apr 13 17:46:43 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:43 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.492s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:43 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:43 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-470a04bf-c6e1-4f61-b457-804dcf1a35f2 tempest-GroupSnapshotsTest-1545235004 None] Delete group completed successfully. Apr 13 17:46:44 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.483s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:44 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Deleted volume successfully. Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-975ed84f-f77c-4be2-ac2d-fbf358925049 tempest-VolumesTransfersV355Test-595357096 None] Lock "cinder-bf47dfeb-baea-4dee-a58a-db096d2629f4-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:44 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f.0118472d-a8a7-4ddb-8341-f41d4ec75f18" returned: 0 in 0.503s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-quobyte-0118472d-a8a7-4ddb-8341-f41d4ec75f18" released by "_delete_snapshot" :: held 2.330s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-quobyte-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" released by "delete_snapshot" :: held 2.358s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Created reservations ['7e79104f-dbd5-4d3f-959b-72a0dbf38be2', '6c8c2759-3325-4844-9152-fa3fec7c1f73', 'caae5d23-4ba1-476a-bdcd-fb9032a27767', 'd15d579f-a6a9-4f44-ac36-b0ac380fa1ee'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:44 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-362490be-b329-4a67-99f2-e088381be961 tempest-GroupSnapshotsTest-1545235004 None] Group tempest-GroupSnapshotsTest-Group-1253091736: creating Apr 13 17:46:44 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-362490be-b329-4a67-99f2-e088381be961 tempest-GroupSnapshotsTest-1545235004 None] Group tempest-GroupSnapshotsTest-Group-1253091736: created successfully Apr 13 17:46:44 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-362490be-b329-4a67-99f2-e088381be961 tempest-GroupSnapshotsTest-1545235004 None] Create group completed successfully. Apr 13 17:46:44 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Delete snapshot completed successfully. Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddfc9d9e-d7f5-4a97-bb03-2e19fc6698c1 tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-0118472d-a8a7-4ddb-8341-f41d4ec75f18-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Creating offline snapshot 75a53629-c01f-41bf-b419-7e355cf8898b of volume d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d1cca-c917-444d-a3cb-9334df472365]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:44 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 Apr 13 17:46:44 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:45 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" returned: 0 in 0.519s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:45 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b 1G Apr 13 17:46:45 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "cinder-b5f8e4c8-fb1e-49ca-80bc-8f699239338f-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-b5f8e4c8-fb1e-49ca-80bc-8f699239338f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "cinder-quobyte-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-quobyte-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a4742-f254-44e2-90a7-98bbdf7c1996]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:45 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f Apr 13 17:46:45 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:45 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b 1G" returned: 0 in 0.630s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:45 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b Apr 13 17:46:45 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:45 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" returned: 0 in 0.559s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:45 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f Apr 13 17:46:45 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Flow 'volume_create_manager' (c6e2418a-f2f3-4953-8107-eb05e169c3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaa36d5-f651-43c2-8369-6705168f901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaa36d5-f651-43c2-8369-6705168f901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1138040703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c35ad07e-bc6b-4dea-b99b-6d1ca8b1b664,host='devstack@QuobyteHD#QuobyteHD',id=3eb66eff-db52-4e79-ac6c-767c72bbb7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6fb70dc31f4910891155ff9977cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:46Z,use_quota=True,user_id='4b56bae7b95243628556403352e49cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6550b2ba-3826-4181-a443-f72b8eae235b),volume_type_id=6550b2ba-3826-4181-a443-f72b8eae235b)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8fbf79-87fb-4f99-a793-69c5272d8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8fbf79-87fb-4f99-a793-69c5272d8b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd30f9d-a78e-4f80-abf2-aa35dde381d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd30f9d-a78e-4f80-abf2-aa35dde381d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb66eff-db52-4e79-ac6c-767c72bbb7c8', 'volume_name': 'volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f135347-ca56-46ae-a8d8-2aa1e69afa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f135347-ca56-46ae-a8d8-2aa1e69afa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2662f9-3730-41f9-992e-1942925feff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:45 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Volume 3eb66eff-db52-4e79-ac6c-767c72bbb7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8', 'volume_size': 1} Apr 13 17:46:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:46 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" returned: 0 in 0.518s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-quobyte-b5f8e4c8-fb1e-49ca-80bc-8f699239338f" released by "delete_volume" :: held 1.123s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:46 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b" returned: 0 in 0.633s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:46 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b is being set with open permissions: ugo+rw Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:46 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b Apr 13 17:46:46 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Created reservations ['49eb2b35-5abd-4b2f-9787-7f4c10c95f88', 'd4c6de75-57ad-4c95-9d6d-290d9a76d029', '6ed1b508-7c26-43e5-9bf3-f3d8d8346b82', 'fe8b7ae0-e9f2-437e-a4e0-30bac1886be9'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:46 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:46 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:46 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b" returned: 0 in 0.502s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:46 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.438s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:46 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Deleted volume successfully. Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd44be3b-4947-4fe4-ad36-6a50da6f2c3e tempest-SnapshotMetadataTestJSON-1280484606 None] Lock "cinder-b5f8e4c8-fb1e-49ca-80bc-8f699239338f-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:46 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.info Apr 13 17:46:46 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:47 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.info" returned: 0 in 0.484s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:47 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.info is being set with open permissions: ugo+rw Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:47 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.info Apr 13 17:46:47 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:47 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.info" returned: 0 in 0.515s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.398s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c35ad07e-bc6b-4dea-b99b-6d1ca8b1b664,created_at=2026-04-13T15:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1138040703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c35ad07e-bc6b-4dea-b99b-6d1ca8b1b664,host='devstack@QuobyteHD#QuobyteHD',id=3eb66eff-db52-4e79-ac6c-767c72bbb7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6fb70dc31f4910891155ff9977cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:46Z,use_quota=True,user_id='4b56bae7b95243628556403352e49cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6550b2ba-3826-4181-a443-f72b8eae235b),volume_type_id=6550b2ba-3826-4181-a443-f72b8eae235b)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Creating volume 3eb66eff-db52-4e79-ac6c-767c72bbb7c8 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:47 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:47 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 1073741824 Apr 13 17:46:47 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:47 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-63bafddc-40b5-4883-b463-7c4ecbdf2c90 tempest-VolumeDependencyTests-461253640 None] Create snapshot completed successfully Apr 13 17:46:48 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 1073741824" returned: 0 in 0.689s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:48 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 Apr 13 17:46:48 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:48 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Flow 'volume_create_manager' (b99d5a36-e931-45ca-95a8-a078943f1ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05e38a8-d977-4296-8133-f47e07722934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05e38a8-d977-4296-8133-f47e07722934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1130756934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a934db-7d20-4c0d-9124-7ab98ffaee90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ad62cf47a744d999e3af14d2945a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75a53629-c01f-41bf-b419-7e355cf8898b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:49Z,use_quota=True,user_id='4a3c5db6390949c38712a9524df4f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b7062e-441d-4b5a-9133-7cdbd306c7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b7062e-441d-4b5a-9133-7cdbd306c7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82394607-34d6-418d-9d24-f2d62f23b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82394607-34d6-418d-9d24-f2d62f23b181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1a934db-7d20-4c0d-9124-7ab98ffaee90', 'volume_name': 'volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90', 'volume_size': 1, 'snapshot_id': '75a53629-c01f-41bf-b419-7e355cf8898b'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74293f5d-8dfb-4575-bd5b-3a8ea4467808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74293f5d-8dfb-4575-bd5b-3a8ea4467808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f88fb1-3a5d-4fd6-a5e8-53569d89832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Volume a1a934db-7d20-4c0d-9124-7ab98ffaee90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90', 'volume_size': 1, 'snapshot_id': '75a53629-c01f-41bf-b419-7e355cf8898b'} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Flow 'volume_create_manager' (314131b9-d58e-4703-b888-8a246cac2ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2feebf-8ef9-484a-84ff-c9d9cb799be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" returned: 0 in 0.596s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2feebf-8ef9-484a-84ff-c9d9cb799be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1846541341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85470941-98b8-4a3e-af7f-0a05c46d141e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b517da7cb39e4a38aae7710ef7022a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:49Z,use_quota=True,user_id='525a3e5a0dda40d282ca7d86ec262fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7afd94-f1e3-4702-8559-c612a96090d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7afd94-f1e3-4702-8559-c612a96090d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed0c4d4-59a1-44a6-8e0a-03f8f62c3eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed0c4d4-59a1-44a6-8e0a-03f8f62c3eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85470941-98b8-4a3e-af7f-0a05c46d141e', 'volume_name': 'volume-85470941-98b8-4a3e-af7f-0a05c46d141e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c672a41-d70f-4706-85c7-a93e12afc2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c672a41-d70f-4706-85c7-a93e12afc2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44207fb7-c2e3-4d4a-a7e5-e7ad5563a948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Volume 85470941-98b8-4a3e-af7f-0a05c46d141e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85470941-98b8-4a3e-af7f-0a05c46d141e', 'volume_size': 1} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1846541341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85470941-98b8-4a3e-af7f-0a05c46d141e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b517da7cb39e4a38aae7710ef7022a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:49Z,use_quota=True,user_id='525a3e5a0dda40d282ca7d86ec262fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Creating volume 85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:49 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:49 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e 1073741824 Apr 13 17:46:49 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2662f9-3730-41f9-992e-1942925feff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2cb9d0-a4c5-4dfa-98d8-7efe67631b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:49 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Volume volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 (3eb66eff-db52-4e79-ac6c-767c72bbb7c8): created successfully Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2cb9d0-a4c5-4dfa-98d8-7efe67631b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Flow 'volume_create_manager' (c6e2418a-f2f3-4953-8107-eb05e169c3a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:49 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b6efcdaa-6c0a-4c8d-9080-d57d501b08db tempest-GroupSnapshotsTest-1545235004 None] Created volume successfully. Apr 13 17:46:49 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e 1073741824" returned: 0 in 0.540s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:49 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e Apr 13 17:46:49 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:50 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] GroupSnapshot 995be40a-4631-424e-8a03-fd1b49fa64d7: creating. Apr 13 17:46:50 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Group snapshot 995be40a-4631-424e-8a03-fd1b49fa64d7: creating. {{(pid=82736) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e" returned: 0 in 0.588s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.315s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-75a53629-c01f-41bf-b419-7e355cf8898b-a1a934db-7d20-4c0d-9124-7ab98ffaee90" by "_create_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44207fb7-c2e3-4d4a-a7e5-e7ad5563a948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85470941-98b8-4a3e-af7f-0a05c46d141e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcce111-0617-45d2-897e-98d51f15ede9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-75a53629-c01f-41bf-b419-7e355cf8898b-a1a934db-7d20-4c0d-9124-7ab98ffaee90" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Creating volume a1a934db-7d20-4c0d-9124-7ab98ffaee90 from snapshot 75a53629-c01f-41bf-b419-7e355cf8898b {{(pid=82736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-a1a934db-7d20-4c0d-9124-7ab98ffaee90" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:50 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Volume volume-85470941-98b8-4a3e-af7f-0a05c46d141e (85470941-98b8-4a3e-af7f-0a05c46d141e): created successfully Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcce111-0617-45d2-897e-98d51f15ede9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Flow 'volume_create_manager' (314131b9-d58e-4703-b888-8a246cac2ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-a1a934db-7d20-4c0d-9124-7ab98ffaee90" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] snapshot: 75a53629-c01f-41bf-b419-7e355cf8898b, volume: a1a934db-7d20-4c0d-9124-7ab98ffaee90, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:50 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-48607fd6-6d6a-4098-a7da-086b0fff0b48 tempest-VolumesDeleteCascade-724339769 None] Created volume successfully. Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f630b04f-53b2-40ed-bcfe-95b8b46f1276]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:50 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b Apr 13 17:46:50 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:51 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b" returned: 0 in 0.540s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e85a3e-d8a2-46bf-b62d-83c2e6a552a0]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:51 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 Apr 13 17:46:51 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:51 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" returned: 0 in 0.602s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:46:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:51 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 Apr 13 17:46:51 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:53 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90" returned: 0 in 2.287s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:53 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a2571-73d9-47e6-b513-1ddbbbdae91c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:54 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 Apr 13 17:46:54 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Flow 'volume_create_manager' (aa7ad6da-bce6-40cc-9ccc-2a7459bee9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc741c43-f76c-4ab0-b1da-b6561e2bb81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc741c43-f76c-4ab0-b1da-b6561e2bb81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1864658195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becb4234-4063-4f8d-a3a5-154749f91a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce9ca845eba64d5c9d0d46352bae4a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:54Z,use_quota=True,user_id='bd3dd2b1713b40f1abc1893e1ba8f237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea18307-9ea8-4bf3-ae01-fb590ba6c525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea18307-9ea8-4bf3-ae01-fb590ba6c525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6867a966-4f63-4d14-b3e2-2e2d59192f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6867a966-4f63-4d14-b3e2-2e2d59192f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'becb4234-4063-4f8d-a3a5-154749f91a52', 'volume_name': 'volume-becb4234-4063-4f8d-a3a5-154749f91a52', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f41f9d2-bd0f-409f-96dd-bf14a20cba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f41f9d2-bd0f-409f-96dd-bf14a20cba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677126d8-6c4f-4ac0-be74-b181be830b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:54 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Volume becb4234-4063-4f8d-a3a5-154749f91a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-becb4234-4063-4f8d-a3a5-154749f91a52', 'volume_size': 1} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:54 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" returned: 0 in 0.596s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:46:54 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Converted 1024.00 MB image at 447.51 MB/s Apr 13 17:46:54 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 is being set with open permissions: ugo+rw Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:54 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 Apr 13 17:46:54 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:54 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90" returned: 0 in 0.389s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-a1a934db-7d20-4c0d-9124-7ab98ffaee90" released by "_copy_volume_from_snapshot" :: held 4.472s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-75a53629-c01f-41bf-b419-7e355cf8898b-a1a934db-7d20-4c0d-9124-7ab98ffaee90" released by "_create_volume_from_snapshot" :: held 4.504s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.530s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.527s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Creating offline snapshot 778ee8fc-336f-435f-9cc6-56b63af4552b of volume 3eb66eff-db52-4e79-ac6c-767c72bbb7c8 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[906a9044-c540-4503-9bc7-eeb57225f78e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f88fb1-3a5d-4fd6-a5e8-53569d89832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90', 'volume_size': 1, 'snapshot_id': '75a53629-c01f-41bf-b419-7e355cf8898b'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddc4a9e-60a9-4a5b-b344-5e0851538ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:55 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Volume volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 (a1a934db-7d20-4c0d-9124-7ab98ffaee90): created successfully Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddc4a9e-60a9-4a5b-b344-5e0851538ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Flow 'volume_create_manager' (b99d5a36-e931-45ca-95a8-a078943f1ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:55 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-25442268-6fe2-4b26-a590-1493f1515b31 tempest-VolumeDependencyTests-461253640 None] Created volume successfully. Apr 13 17:46:55 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 Apr 13 17:46:55 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-75a53629-c01f-41bf-b419-7e355cf8898b-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-75a53629-c01f-41bf-b419-7e355cf8898b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-75a53629-c01f-41bf-b419-7e355cf8898b" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-75a53629-c01f-41bf-b419-7e355cf8898b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Deleting offline snapshot 75a53629-c01f-41bf-b419-7e355cf8898b of volume d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] snapshot_file for this snap is: volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[139179fb-7d0a-413c-b28e-51af0ae6c7b1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:55 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" returned: 0 in 0.487s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:55 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b 1G Apr 13 17:46:55 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:55 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b Apr 13 17:46:55 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:55 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b" returned: 0 in 0.486s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec002e0e-8310-43d4-9383-203d58e04562]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:55 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b 1G" returned: 0 in 0.465s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:55 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b Apr 13 17:46:55 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:55 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 Apr 13 17:46:55 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:56 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b" returned: 0 in 0.467s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:56 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:46:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:56 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:56 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b Apr 13 17:46:56 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" returned: 0 in 0.516s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:56 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b Apr 13 17:46:56 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:56 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b" returned: 0 in 0.437s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:56 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.info Apr 13 17:46:56 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:56 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b" returned: 0 in 0.453s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:56 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b Apr 13 17:46:56 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:57 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.info" returned: 0 in 0.399s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:57 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:57 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.info Apr 13 17:46:57 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:57 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054.75a53629-c01f-41bf-b419-7e355cf8898b" returned: 0 in 0.403s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-75a53629-c01f-41bf-b419-7e355cf8898b" released by "_delete_snapshot" :: held 1.914s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" released by "delete_snapshot" :: held 1.929s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Created reservations ['ffd35863-466f-4be2-8a28-ffb98134d3ee', '3e467a28-87d1-4b91-8289-14366ab6f978', '423fa10f-49f4-4ca2-a69b-102ee814f8d7', '8538ff31-5a44-4457-9c7f-13b90a42e27c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Delete snapshot completed successfully. Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ffa3f30-09f4-4de4-a119-333d266918a0 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-75a53629-c01f-41bf-b419-7e355cf8898b-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Lock "cinder-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" acquired by "delete_volume" :: waited 0.018s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad1a56-14f8-4d77-b7d3-56293ff74610]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:57 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 Apr 13 17:46:57 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:57 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.info" returned: 0 in 0.426s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.738s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.186s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Creating offline snapshot 1ca5c27d-508c-4958-8a72-4304dae7ba27 of volume 85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd740e3-fc97-4904-82b2-614796d859b3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2aa19dcb-7e60-465d-baed-a0ed4b987e2e tempest-GroupSnapshotsTest-1545235004 None] group_snapshot 995be40a-4631-424e-8a03-fd1b49fa64d7: created successfully Apr 13 17:46:57 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e Apr 13 17:46:57 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:58 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" returned: 0 in 0.472s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:58 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054 Apr 13 17:46:58 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:58 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e" returned: 0 in 0.468s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:58 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 1G Apr 13 17:46:58 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:58 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" returned: 0 in 0.408s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054" released by "delete_volume" :: held 0.910s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Created reservations ['696cfcd0-d06e-421d-8b8c-703d472edb2a', '193f2f16-146d-4627-8b1d-24880c2c44fe', '3c894b3f-f124-4fc7-aad6-a5c948621cb1', 'd23d484c-cf3c-474b-a3f3-da1204523e7f'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:58 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:46:58 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:58 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 1G" returned: 0 in 0.542s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:58 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 Apr 13 17:46:58 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:58 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot 995be40a-4631-424e-8a03-fd1b49fa64d7: deleting Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Flow 'volume_create_manager' (37a97375-8ae8-4ac3-aa55-9d6d1719f674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a47552-75a7-4672-acc6-7bd6a3aa6139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a47552-75a7-4672-acc6-7bd6a3aa6139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-948520975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786f4acd-3e88-4bd5-b6f9-23b65fd4efda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ad62cf47a744d999e3af14d2945a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:59Z,use_quota=True,user_id='4a3c5db6390949c38712a9524df4f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:58 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a9c383-3910-4031-acba-f75e940531ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a9c383-3910-4031-acba-f75e940531ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6362fdd-1bfd-4996-903d-217e8aaea153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6362fdd-1bfd-4996-903d-217e8aaea153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786f4acd-3e88-4bd5-b6f9-23b65fd4efda', 'volume_name': 'volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c133b86-8078-4350-ab5d-5643c00bc95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c133b86-8078-4350-ab5d-5643c00bc95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818eb1a6-dfd8-461e-a266-24744f55fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:46:59 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Volume 786f4acd-3e88-4bd5-b6f9-23b65fd4efda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda', 'volume_size': 1} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:46:59 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot 995be40a-4631-424e-8a03-fd1b49fa64d7: deleting {{(pid=82736) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.471s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:46:59 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Deleted volume successfully. Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1e820091-5129-4446-bf6c-b67866a5695b tempest-VolumeDependencyTests-461253640 None] Lock "cinder-d14d4ccd-a3a8-4ae0-9288-e2d3b446c054-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-778ee8fc-336f-435f-9cc6-56b63af4552b" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-778ee8fc-336f-435f-9cc6-56b63af4552b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Deleting offline snapshot 778ee8fc-336f-435f-9cc6-56b63af4552b of volume 3eb66eff-db52-4e79-ac6c-767c72bbb7c8 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] snapshot_file for this snap is: volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f554e-245f-4f5c-bd24-fbb1100499a9]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:59 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b Apr 13 17:46:59 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:59 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27" returned: 0 in 0.552s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:59 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 is being set with open permissions: ugo+rw Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:59 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 Apr 13 17:46:59 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:59 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b" returned: 0 in 0.498s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1101c785-8d78-4328-a1a4-41398b82b9f4]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:59 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 Apr 13 17:46:59 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:46:59 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27" returned: 0 in 0.401s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:46:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:46:59 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.info Apr 13 17:46:59 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:00 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" returned: 0 in 0.476s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:00 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b Apr 13 17:47:00 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:00 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.info" returned: 0 in 0.426s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:00 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.info is being set with open permissions: ugo+rw Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:00 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.info Apr 13 17:47:00 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:00 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b" returned: 0 in 0.430s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:00 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b Apr 13 17:47:00 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:00 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.info" returned: 0 in 0.400s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.210s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1864658195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becb4234-4063-4f8d-a3a5-154749f91a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce9ca845eba64d5c9d0d46352bae4a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:54Z,use_quota=True,user_id='bd3dd2b1713b40f1abc1893e1ba8f237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Creating volume becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:47:00 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:00 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 1073741824 Apr 13 17:47:00 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:00 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b847a156-d232-46b5-bfe9-4aed0d898581 tempest-VolumesDeleteCascade-724339769 None] Create snapshot completed successfully Apr 13 17:47:00 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8.778ee8fc-336f-435f-9cc6-56b63af4552b" returned: 0 in 0.414s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-778ee8fc-336f-435f-9cc6-56b63af4552b" released by "_delete_snapshot" :: held 1.866s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" released by "delete_snapshot" :: held 1.882s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:01 devstack cinder-volume[82736]: WARNING cinder.quota [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-36196860 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-36196860, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:47:01 devstack cinder-volume[82736]: WARNING cinder.quota [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-36196860 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-36196860, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['f9b33f6b-7cd5-4d79-afc9-3a30ae7467fe', '3bf8c72f-d932-4923-afc9-d94b2ab0f01d', 'cb0d37a7-eb0d-4a2e-9409-8ce88a21450d', '072b0729-af15-4d46-b867-4eb00a18ab92'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6789151e-ab32-44b7-a6a5-8cf7bb566360 tempest-GroupSnapshotsTest-1545235004 None] group_snapshot 995be40a-4631-424e-8a03-fd1b49fa64d7: deleted successfully Apr 13 17:47:01 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 1073741824" returned: 0 in 0.507s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:01 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:47:01 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "cinder-quobyte-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ad7217-2640-4acb-91da-d48d68f37ac5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:01 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 Apr 13 17:47:01 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:01 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.433s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.518s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-948520975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786f4acd-3e88-4bd5-b6f9-23b65fd4efda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ad62cf47a744d999e3af14d2945a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:46:59Z,use_quota=True,user_id='4a3c5db6390949c38712a9524df4f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Creating volume 786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:47:01 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:01 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda 1073741824 Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677126d8-6c4f-4ac0-be74-b181be830b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becb4234-4063-4f8d-a3a5-154749f91a52', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:01 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32b31f1-7158-4e70-b430-b13400e82bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:01 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Volume volume-becb4234-4063-4f8d-a3a5-154749f91a52 (becb4234-4063-4f8d-a3a5-154749f91a52): created successfully Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32b31f1-7158-4e70-b430-b13400e82bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Flow 'volume_create_manager' (aa7ad6da-bce6-40cc-9ccc-2a7459bee9dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-958b90df-60d9-47d4-af38-f36f9e2fa52e tempest-VolumesActionsTest-205723266 None] Created volume successfully. Apr 13 17:47:01 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" returned: 0 in 0.469s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:01 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8 Apr 13 17:47:01 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:02 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda 1073741824" returned: 0 in 0.466s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:02 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda Apr 13 17:47:02 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:02 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" returned: 0 in 0.420s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Lock "cinder-quobyte-3eb66eff-db52-4e79-ac6c-767c72bbb7c8" released by "delete_volume" :: held 0.923s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['305accdf-9fc1-4a85-8de5-4d165b17bd63'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:02 devstack cinder-volume[82736]: WARNING cinder.quota [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-36196860 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-36196860, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Created reservations ['6ffd3463-4515-47e4-8a5f-6e17ff9882b3', '1a73d0a2-44b8-4b43-8150-c3e57d6d6f25', '5be6cb38-6c28-4796-92bf-151f4be6aa46', '0117a8fc-ff43-478d-807f-9008cf50533c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:02 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:02 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:02 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" returned: 0 in 0.431s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.308s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Creating offline snapshot 1cbd9c3b-a10f-40a0-a497-b67980f365c9 of volume 85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818eb1a6-dfd8-461e-a266-24744f55fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68a1151-cdd0-4081-bedb-ace6d8b2762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b951710-b7d5-4ca2-84ce-4b9d29b8d2c3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:02 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Volume volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda (786f4acd-3e88-4bd5-b6f9-23b65fd4efda): created successfully Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68a1151-cdd0-4081-bedb-ace6d8b2762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Flow 'volume_create_manager' (37a97375-8ae8-4ac3-aa55-9d6d1719f674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:02 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f219e132-0699-48c2-bf40-23ea730f85a7 tempest-VolumeDependencyTests-461253640 None] Created volume successfully. Apr 13 17:47:02 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 Apr 13 17:47:02 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:02 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.480s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:02 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:02 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a4805561-d5f9-4770-b92c-c0478290dee4 tempest-GroupSnapshotsTest-1545235004 None] Delete group completed successfully. Apr 13 17:47:03 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27" returned: 0 in 0.554s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85470941-98b8-4a3e-af7f-0a05c46d141e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:03 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 1G Apr 13 17:47:03 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Flow 'volume_create_manager' (1fe7927f-76ab-4033-a113-ca79bd12ef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f0e1f1-fb94-4576-a454-ca5ee507b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f0e1f1-fb94-4576-a454-ca5ee507b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-768480917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95bc9ff-ec89-4ffb-bbed-6f2de91dd660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ad62cf47a744d999e3af14d2945a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=786f4acd-3e88-4bd5-b6f9-23b65fd4efda,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:03Z,use_quota=True,user_id='4a3c5db6390949c38712a9524df4f3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b416306-66ec-485e-84bc-2c21fa70c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b416306-66ec-485e-84bc-2c21fa70c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd87d7fc-eb80-4d18-9769-8e0ae264ef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd87d7fc-eb80-4d18-9769-8e0ae264ef32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e95bc9ff-ec89-4ffb-bbed-6f2de91dd660', 'volume_name': 'volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660', 'volume_size': 1, 'source_volid': '786f4acd-3e88-4bd5-b6f9-23b65fd4efda', 'source_volstatus': 'available'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e024dd-ddba-4ac8-9537-e2c1a03d98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e024dd-ddba-4ac8-9537-e2c1a03d98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccf4175-75f7-426e-ab98-6915828369b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:03 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Volume e95bc9ff-ec89-4ffb-bbed-6f2de91dd660: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660', 'volume_size': 1, 'source_volid': '786f4acd-3e88-4bd5-b6f9-23b65fd4efda', 'source_volstatus': 'available'} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:03 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 1G" returned: 0 in 0.738s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:03 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 Apr 13 17:47:03 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:04 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9" returned: 0 in 0.542s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:04 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 is being set with open permissions: ugo+rw Apr 13 17:47:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:04 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 Apr 13 17:47:04 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:04 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.303s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:04 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Cloning volume 786f4acd-3e88-4bd5-b6f9-23b65fd4efda to volume e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 Apr 13 17:47:04 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c1c73193-8308-4ac7-be31-e9fb0a91fe4e tempest-VolumesDeleteCascade-724339769 None] Create snapshot completed successfully Apr 13 17:47:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Creating offline snapshot 150a707d-6221-42ed-ab99-850a1023a0de of volume 786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:04 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3f1b6e-b584-46ab-b0fe-ec6ac04c367b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:04 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda Apr 13 17:47:04 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-85470941-98b8-4a3e-af7f-0a05c46d141e-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-85470941-98b8-4a3e-af7f-0a05c46d141e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:05 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Performing cascade delete. {{(pid=82736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" returned: 0 in 0.569s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-1ca5c27d-508c-4958-8a72-4304dae7ba27-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-1ca5c27d-508c-4958-8a72-4304dae7ba27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:05 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de 1G Apr 13 17:47:05 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-1ca5c27d-508c-4958-8a72-4304dae7ba27" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-1ca5c27d-508c-4958-8a72-4304dae7ba27" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Deleting offline snapshot 1ca5c27d-508c-4958-8a72-4304dae7ba27 of volume 85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] snapshot_file for this snap is: volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f349ba-8a37-416d-929d-2f99ecd9ea1e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:05 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 Apr 13 17:47:05 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:06 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de 1G" returned: 0 in 0.537s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:06 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de Apr 13 17:47:06 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:06 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27" returned: 0 in 0.638s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85470941-98b8-4a3e-af7f-0a05c46d141e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a98085-31d6-4c15-aa99-317e4471ef8f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:06 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e Apr 13 17:47:06 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:06 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de" returned: 0 in 0.544s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:06 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de is being set with open permissions: ugo+rw Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:06 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de Apr 13 17:47:06 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:06 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e" returned: 0 in 0.723s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01b419d-73d9-456c-89b5-5f0110d10ccb]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:07 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de" returned: 0 in 0.462s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:07 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 Apr 13 17:47:07 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:07 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.info Apr 13 17:47:07 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:07 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.info" returned: 0 in 0.428s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:07 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.info is being set with open permissions: ugo+rw Apr 13 17:47:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:07 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.info Apr 13 17:47:07 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:07 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9" returned: 0 in 0.708s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85470941-98b8-4a3e-af7f-0a05c46d141e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:07 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c39512-2dc6-43ec-86aa-ef107b2d0676]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:07 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 Apr 13 17:47:07 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:08 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.info" returned: 0 in 0.607s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] snapshot: 150a707d-6221-42ed-ab99-850a1023a0de, volume: e95bc9ff-ec89-4ffb-bbed-6f2de91dd660, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fd2941-508c-439b-8fec-8621e3c3aa3a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:08 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de Apr 13 17:47:08 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:08 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27" returned: 0 in 0.613s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85470941-98b8-4a3e-af7f-0a05c46d141e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6752a-cf06-4b15-a286-fb957704a313]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:08 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e Apr 13 17:47:08 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:08 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de" returned: 0 in 0.643s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2736c4-7642-48d4-80f8-059eed663196]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:08 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda Apr 13 17:47:08 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:08 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e" returned: 0 in 0.591s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:08 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 Apr 13 17:47:08 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:09 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" returned: 0 in 0.591s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:09 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 Apr 13 17:47:09 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:09 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27" returned: 0 in 0.694s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:09 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27 Apr 13 17:47:09 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:09 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:09 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:10 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1ca5c27d-508c-4958-8a72-4304dae7ba27" returned: 0 in 0.626s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 -F qcow2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:10 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 -F qcow2 Apr 13 17:47:10 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:11 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 1.278s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:11 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:12 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" returned: 0 in 2.751s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f8f139-5313-450e-8896-8e273fa55526]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:12 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85470941-98b8-4a3e-af7f-0a05c46d141e /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 -F qcow2" returned: 0 in 1.972s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-1ca5c27d-508c-4958-8a72-4304dae7ba27" released by "_delete_snapshot" :: held 6.667s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" released by "delete_snapshot" :: held 6.679s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Created reservations ['3311023b-2b77-46a0-a413-d2e213094838', '3d6dfaaa-82c8-47e7-bf91-936b547c5b42', 'adc40a3e-c40b-496b-ac36-09dfdb08b0b8', '02141c46-6447-4538-b703-8e13d3b5e4db'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:12 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda Apr 13 17:47:12 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:12 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Delete snapshot completed successfully. Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-1ca5c27d-508c-4958-8a72-4304dae7ba27-delete_snapshot" released by "delete_snapshot" :: held 6.792s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-1cbd9c3b-a10f-40a0-a497-b67980f365c9-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-1cbd9c3b-a10f-40a0-a497-b67980f365c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-1cbd9c3b-a10f-40a0-a497-b67980f365c9" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-1cbd9c3b-a10f-40a0-a497-b67980f365c9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Deleting offline snapshot 1cbd9c3b-a10f-40a0-a497-b67980f365c9 of volume 85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] snapshot_file for this snap is: volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaa39fa-9244-409e-92c1-bf61f0f1a029]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:12 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 Apr 13 17:47:12 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Flow 'volume_create_manager' (19ad9488-a3bd-4f37-8255-15d38fb84da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf72789-7ac7-4099-bcf5-91ed19b83add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf72789-7ac7-4099-bcf5-91ed19b83add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-326031367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25bc9d3-df15-41b5-b22e-b7b4a2de3b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f8b0cbc1d4c4d8fc7dee41a36a667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:13Z,use_quota=True,user_id='b5debd31f06e4ff0ab549e04b5da8bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6eb89b-bbe4-4d4d-b694-af564331cd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6eb89b-bbe4-4d4d-b694-af564331cd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029d44c7-e691-4f5c-a7b0-2b1dc377a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029d44c7-e691-4f5c-a7b0-2b1dc377a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25bc9d3-df15-41b5-b22e-b7b4a2de3b01', 'volume_name': 'volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d22969-e50e-41b9-aa80-4941127d2bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d22969-e50e-41b9-aa80-4941127d2bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0abfbb9-b21c-4ae2-9d75-a9544c7d3bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:12 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01', 'volume_size': 1} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:12 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9" returned: 0 in 0.501s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85470941-98b8-4a3e-af7f-0a05c46d141e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f0689a-bb43-4103-b5e7-a26a499a686b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:12 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" returned: 0 in 0.775s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda, size 1024.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:47:12 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Converted 1024.00 MB image at 372.14 MB/s Apr 13 17:47:12 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 is being set with open permissions: ugo+rw Apr 13 17:47:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:12 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 Apr 13 17:47:12 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:12 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e Apr 13 17:47:12 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:13 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" returned: 0 in 0.450s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" released by "_copy_volume_from_snapshot" :: held 5.262s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:13 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e" returned: 0 in 0.519s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-150a707d-6221-42ed-ab99-850a1023a0de" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-150a707d-6221-42ed-ab99-850a1023a0de" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Deleting offline snapshot 150a707d-6221-42ed-ab99-850a1023a0de of volume 786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:13 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 Apr 13 17:47:13 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] snapshot_file for this snap is: volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[79248f04-b9a9-4abe-ac1b-9def1e213b2a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:13 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de Apr 13 17:47:13 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:13 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9" returned: 0 in 0.511s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:13 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9 Apr 13 17:47:13 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:13 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de" returned: 0 in 0.532s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6a7d75-55f0-4ab8-a6f3-175e5513aedd]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:14 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda Apr 13 17:47:14 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:14 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e.1cbd9c3b-a10f-40a0-a497-b67980f365c9" returned: 0 in 0.447s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-1cbd9c3b-a10f-40a0-a497-b67980f365c9" released by "_delete_snapshot" :: held 2.029s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" released by "delete_snapshot" :: held 2.046s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Created reservations ['a3cee9a4-9413-4cb6-b230-0b84fa5efeda', '16b0c864-000e-4daf-aad6-76839d03bd71', '5c822ce7-dfa8-41a4-8c90-b5e99014c494', 'a81ac282-cb06-47bd-ac49-360c6642e449'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:14 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Delete snapshot completed successfully. Apr 13 17:47:14 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-1cbd9c3b-a10f-40a0-a497-b67980f365c9-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Snapshots deleted, issuing volume delete {{(pid=82736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" returned: 0 in 0.498s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" acquired by "delete_volume" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:14 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de Apr 13 17:47:14 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[85507a63-f289-40c7-8943-34a3ed0b09ba]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:14 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e Apr 13 17:47:14 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:14 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:14 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de Apr 13 17:47:14 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:15 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e" returned: 0 in 0.659s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:15 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e Apr 13 17:47:15 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:15 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda.150a707d-6221-42ed-ab99-850a1023a0de" returned: 0 in 0.680s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-150a707d-6221-42ed-ab99-850a1023a0de" released by "_delete_snapshot" :: held 2.247s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.819s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-326031367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25bc9d3-df15-41b5-b22e-b7b4a2de3b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f8b0cbc1d4c4d8fc7dee41a36a667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:13Z,use_quota=True,user_id='b5debd31f06e4ff0ab549e04b5da8bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Creating volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:47:15 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:15 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 1073741824 Apr 13 17:47:15 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccf4175-75f7-426e-ab98-6915828369b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660', 'volume_size': 1, 'source_volid': '786f4acd-3e88-4bd5-b6f9-23b65fd4efda', 'source_volstatus': 'available'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf634d73-e31b-4f09-950d-b934b2e633b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Volume volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 (e95bc9ff-ec89-4ffb-bbed-6f2de91dd660): created successfully Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf634d73-e31b-4f09-950d-b934b2e633b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Flow 'volume_create_manager' (1fe7927f-76ab-4033-a113-ca79bd12ef63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:15 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-dbc49c4a-d2c3-4299-b145-3aeb642f9356 tempest-VolumeDependencyTests-461253640 None] Created volume successfully. Apr 13 17:47:15 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-85470941-98b8-4a3e-af7f-0a05c46d141e" returned: 0 in 0.731s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-85470941-98b8-4a3e-af7f-0a05c46d141e" released by "delete_volume" :: held 1.419s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Created reservations ['83b64af1-da2c-4f05-8408-8c54e4876edd', 'bb052a73-0509-4f3b-9407-5aeef1e64efd', 'e9cf93fb-d2b0-49ea-8dd9-4cb0214494f2', 'abfed0b5-3c2d-441d-84cc-bd9b739b6c74'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:15 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:15 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:16 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 1073741824" returned: 0 in 0.696s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:16 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 Apr 13 17:47:16 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:16 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:16 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Deleted volume successfully. Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-aeef48d6-2516-4a35-b003-c922ef5deaf5 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-85470941-98b8-4a3e-af7f-0a05c46d141e-delete_volume" released by "delete_volume" :: held 11.077s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-786f4acd-3e88-4bd5-b6f9-23b65fd4efda-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Lock "cinder-786f4acd-3e88-4bd5-b6f9-23b65fd4efda-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[39333a9c-f768-4c04-9a2e-fb3474947070]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:16 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda Apr 13 17:47:16 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Flow 'volume_create_manager' (5f28e08d-6ea8-4c03-94ae-d64b7da91826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b2188b-3272-467a-b540-6b7a666ee073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b2188b-3272-467a-b540-6b7a666ee073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-967844105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bedf316-8f77-4071-a5ca-d6998b647a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b517da7cb39e4a38aae7710ef7022a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:17Z,use_quota=True,user_id='525a3e5a0dda40d282ca7d86ec262fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8bbcbd-b3b6-4a8d-b551-d39c198f6494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8bbcbd-b3b6-4a8d-b551-d39c198f6494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b34c560-6841-42b1-93b9-485010481b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b34c560-6841-42b1-93b9-485010481b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bedf316-8f77-4071-a5ca-d6998b647a82', 'volume_name': 'volume-8bedf316-8f77-4071-a5ca-d6998b647a82', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cd13cd-c8d1-4313-8342-7cccfa35ecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cd13cd-c8d1-4313-8342-7cccfa35ecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f6688e-ad6a-488f-b4fd-904cf3b41487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Volume 8bedf316-8f77-4071-a5ca-d6998b647a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bedf316-8f77-4071-a5ca-d6998b647a82', 'volume_size': 1} Apr 13 17:47:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:17 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" returned: 0 in 0.620s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.065s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-967844105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bedf316-8f77-4071-a5ca-d6998b647a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b517da7cb39e4a38aae7710ef7022a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:17Z,use_quota=True,user_id='525a3e5a0dda40d282ca7d86ec262fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Creating volume 8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:47:17 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0abfbb9-b21c-4ae2-9d75-a9544c7d3bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1680b1d1-d451-4496-a7b3-d7ffe2a1c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:17 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 1073741824 Apr 13 17:47:17 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:17 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Volume volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 (e25bc9d3-df15-41b5-b22e-b7b4a2de3b01): created successfully Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1680b1d1-d451-4496-a7b3-d7ffe2a1c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Flow 'volume_create_manager' (19ad9488-a3bd-4f37-8255-15d38fb84da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4609b134-9184-41e4-a8c3-425743ad5c9b tempest-SnapshotsActionsTest-401054584 None] Created volume successfully. Apr 13 17:47:17 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" returned: 0 in 0.546s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:17 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda Apr 13 17:47:17 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:17 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 1073741824" returned: 0 in 0.524s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:17 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 Apr 13 17:47:17 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:17 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-786f4acd-3e88-4bd5-b6f9-23b65fd4efda" released by "delete_volume" :: held 1.099s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d6e2424b-d341-461c-840a-71ae95f649c2 tempest-VolumesActionsTest-205723266 None] Acquiring lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52" by "attach_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Created reservations ['0e0291a8-07ff-4a61-98cc-874127e34dbd', '382e7bca-d997-4d4e-a342-856f4e5f3207', 'bb2327db-baa2-43ab-9074-ab6a7d7d8130', '9f122eeb-69a8-4b94-b748-b367af2bac39'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d6e2424b-d341-461c-840a-71ae95f649c2 tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52" acquired by "attach_volume" :: waited 0.027s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d6e2424b-d341-461c-840a-71ae95f649c2 tempest-VolumesActionsTest-205723266 None] Attaching volume becb4234-4063-4f8d-a3a5-154749f91a52 to instance 5746d045-9904-4af7-bcbe-d7df12918b5f at mountpoint /dev/vdb on host None. Apr 13 17:47:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d6e2424b-d341-461c-840a-71ae95f649c2 tempest-VolumesActionsTest-205723266 None] Attach volume completed successfully. Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d6e2424b-d341-461c-840a-71ae95f649c2 tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52" released by "attach_volume" :: held 0.064s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:17 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:17 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:18 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82" returned: 0 in 0.463s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f6688e-ad6a-488f-b4fd-904cf3b41487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bedf316-8f77-4071-a5ca-d6998b647a82', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405217f6-1087-4e5f-8903-cbcb9564a0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:18 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Volume volume-8bedf316-8f77-4071-a5ca-d6998b647a82 (8bedf316-8f77-4071-a5ca-d6998b647a82): created successfully Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405217f6-1087-4e5f-8903-cbcb9564a0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Flow 'volume_create_manager' (5f28e08d-6ea8-4c03-94ae-d64b7da91826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Creating offline snapshot 901848f4-3d23-4486-8ce0-55c657784fa2 of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-714d97de-59ed-4ba0-ae16-dcc11f095151 tempest-VolumesDeleteCascade-724339769 None] Created volume successfully. Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2488ab0-8dfb-4a67-9cf1-f6034cd5ad10]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:18 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 Apr 13 17:47:18 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:18 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.449s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Deleted volume successfully. Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7b406ed0-fbda-437a-ab23-b26f0bdd31ec tempest-VolumeDependencyTests-461253640 None] Lock "cinder-786f4acd-3e88-4bd5-b6f9-23b65fd4efda-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75f589bb-97f4-46c1-8d76-19a8d4fb17a2 tempest-VolumesActionsTest-205723266 None] Acquiring lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-detach_volume" by "detach_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75f589bb-97f4-46c1-8d76-19a8d4fb17a2 tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-75f589bb-97f4-46c1-8d76-19a8d4fb17a2 tempest-VolumesActionsTest-205723266 None] Detaching volume becb4234-4063-4f8d-a3a5-154749f91a52 from instance 5746d045-9904-4af7-bcbe-d7df12918b5f. Apr 13 17:47:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-75f589bb-97f4-46c1-8d76-19a8d4fb17a2 tempest-VolumesActionsTest-205723266 None] Detach volume completed successfully. Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75f589bb-97f4-46c1-8d76-19a8d4fb17a2 tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:18 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:18 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 1G Apr 13 17:47:18 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f34620-8dd4-4ecb-a9a6-8ab8ad7628fb]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:18 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 Apr 13 17:47:18 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:19 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" returned: 0 in 0.562s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:19 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660 Apr 13 17:47:19 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:19 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 1G" returned: 0 in 0.781s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:19 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:19 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:19 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" returned: 0 in 0.409s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660" released by "delete_volume" :: held 1.001s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:19 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.429s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:19 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 is being set with open permissions: ugo+rw Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:19 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:19 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Created reservations ['4bf3c76f-32e1-4a2e-9b3a-b722a7e6b0c6', '8c123648-4264-4af9-815d-80e1dcb2f346', '7aabcb03-7568-4800-b467-552a20f736c4', '091ea64c-7432-458f-ac3a-979e1cf59732'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:19 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:19 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:20 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.455s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:20 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.info Apr 13 17:47:20 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:20 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.522s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:20 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:20 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Deleted volume successfully. Apr 13 17:47:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20651e80-6d82-438b-b77d-5ac3d286f2e4 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-e95bc9ff-ec89-4ffb-bbed-6f2de91dd660-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:20 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.info" returned: 0 in 0.481s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:20 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.info is being set with open permissions: ugo+rw Apr 13 17:47:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:20 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.info Apr 13 17:47:20 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-a1a934db-7d20-4c0d-9124-7ab98ffaee90-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-a1a934db-7d20-4c0d-9124-7ab98ffaee90-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "cinder-quobyte-a1a934db-7d20-4c0d-9124-7ab98ffaee90" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-a1a934db-7d20-4c0d-9124-7ab98ffaee90" acquired by "delete_volume" :: waited 0.019s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17a4918-04d4-4532-9a33-8174896c1cc5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:21 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 Apr 13 17:47:21 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:21 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.info" returned: 0 in 0.429s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.126s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.093s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Creating offline snapshot 4714964a-9b22-4f69-8d65-050b33aab72d of volume 8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:21 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-adab31d9-c6eb-4e13-aa7c-dab966e7d453 tempest-SnapshotsActionsTest-401054584 None] Create snapshot completed successfully Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[738767c4-44a5-4880-9a5c-6f1b4b93c569]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:21 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 Apr 13 17:47:21 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:21 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90" returned: 0 in 0.519s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:21 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90 Apr 13 17:47:21 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:21 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82" returned: 0 in 0.557s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:21 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d 1G Apr 13 17:47:21 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:22 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a1a934db-7d20-4c0d-9124-7ab98ffaee90" returned: 0 in 0.450s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-quobyte-a1a934db-7d20-4c0d-9124-7ab98ffaee90" released by "delete_volume" :: held 0.990s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Created reservations ['2dbd54df-4db6-49b6-a244-032bd7769f74', 'aab722e7-e6ab-48b2-9f86-b19d914b6e9b', 'f6125280-86f7-43e1-beca-34e0323c8061', '9bce2b20-01a7-46a6-b484-2167cfa7d9c7'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:22 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:22 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:22 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d 1G" returned: 0 in 0.520s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bedf316-8f77-4071-a5ca-d6998b647a82 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:22 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bedf316-8f77-4071-a5ca-d6998b647a82 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d Apr 13 17:47:22 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:22 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.495s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:22 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Deleted volume successfully. Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f3b3be30-2421-4a3d-9fdf-5d7662d36032 tempest-VolumeDependencyTests-461253640 None] Lock "cinder-a1a934db-7d20-4c0d-9124-7ab98ffaee90-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:22 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bedf316-8f77-4071-a5ca-d6998b647a82 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d" returned: 0 in 0.442s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:22 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d is being set with open permissions: ugo+rw Apr 13 17:47:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:22 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d Apr 13 17:47:22 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:23 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d" returned: 0 in 0.423s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:23 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.info Apr 13 17:47:23 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:23 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.info" returned: 0 in 0.480s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:23 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.info is being set with open permissions: ugo+rw Apr 13 17:47:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:23 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.info Apr 13 17:47:23 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:24 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.info" returned: 0 in 0.476s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.968s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.666s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Creating offline snapshot f3600874-e735-4178-a529-663a5b13f0c6 of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:24 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-da14ba2f-989e-44da-ac43-fc1ef9c4cb22 tempest-VolumesDeleteCascade-724339769 None] Create snapshot completed successfully Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab5c18-ae14-4981-971a-cc211fdbe95e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:24 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:24 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Flow 'volume_create_manager' (3235427a-fd35-49ed-adc3-075016e11fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751e7406-6741-4f46-8b1b-8ac8a10520bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751e7406-6741-4f46-8b1b-8ac8a10520bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1690994750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b29586-825d-408b-8b64-76e600fa7df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b517da7cb39e4a38aae7710ef7022a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4714964a-9b22-4f69-8d65-050b33aab72d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:25Z,use_quota=True,user_id='525a3e5a0dda40d282ca7d86ec262fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc34e29-64f7-417f-9302-13171af75805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc34e29-64f7-417f-9302-13171af75805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c797cb-1a6b-4c2f-9513-3891477b89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c797cb-1a6b-4c2f-9513-3891477b89ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96b29586-825d-408b-8b64-76e600fa7df9', 'volume_name': 'volume-96b29586-825d-408b-8b64-76e600fa7df9', 'volume_size': 1, 'snapshot_id': '4714964a-9b22-4f69-8d65-050b33aab72d'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973547df-3eaf-44f0-9328-52c8e2d58fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973547df-3eaf-44f0-9328-52c8e2d58fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae154f0-7a97-4b12-b617-2b691c544d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:24 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Volume 96b29586-825d-408b-8b64-76e600fa7df9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96b29586-825d-408b-8b64-76e600fa7df9', 'volume_size': 1, 'snapshot_id': '4714964a-9b22-4f69-8d65-050b33aab72d'} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:24 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:24 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 1G Apr 13 17:47:24 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Flow 'volume_create_manager' (2fda1e4b-b382-4f7f-bd27-47d0067ff3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f4c2b9-5378-42bf-894d-6a5a01ba64d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f4c2b9-5378-42bf-894d-6a5a01ba64d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3efdde-1c9e-4f64-9e55-66ac6b87d976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e45c6722c89434dab5024e5f52a2d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:25Z,use_quota=True,user_id='1ad646f315ab45b7aa61ad09ad74eee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d24a95-c0ac-4a70-8693-57a3c620c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d24a95-c0ac-4a70-8693-57a3c620c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c574e2fb-a32d-4ce6-b3cb-69022aaf811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c574e2fb-a32d-4ce6-b3cb-69022aaf811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3efdde-1c9e-4f64-9e55-66ac6b87d976', 'volume_name': 'volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c8901c-69fc-4b54-87bf-d94c974e3c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c8901c-69fc-4b54-87bf-d94c974e3c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06478c31-0a46-49da-b1c8-dd49c6c9a231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:25 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Volume 9c3efdde-1c9e-4f64-9e55-66ac6b87d976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976', 'volume_size': 1} Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:25 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 1G" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:25 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 Apr 13 17:47:25 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:25 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:25 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 is being set with open permissions: ugo+rw Apr 13 17:47:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:25 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 Apr 13 17:47:25 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:26 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6" returned: 0 in 0.419s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.507s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-4714964a-9b22-4f69-8d65-050b33aab72d-96b29586-825d-408b-8b64-76e600fa7df9" by "_create_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-4714964a-9b22-4f69-8d65-050b33aab72d-96b29586-825d-408b-8b64-76e600fa7df9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Creating volume 96b29586-825d-408b-8b64-76e600fa7df9 from snapshot 4714964a-9b22-4f69-8d65-050b33aab72d {{(pid=82736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-96b29586-825d-408b-8b64-76e600fa7df9" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6303c11e-14d2-46bf-a7a2-1a7c3e031878 tempest-SnapshotsActionsTest-401054584 None] Create snapshot completed successfully Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-96b29586-825d-408b-8b64-76e600fa7df9" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] snapshot: 4714964a-9b22-4f69-8d65-050b33aab72d, volume: 96b29586-825d-408b-8b64-76e600fa7df9, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b8662d-965c-4224-9ea1-2313f203cd31]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:26 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d Apr 13 17:47:26 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:26 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d" returned: 0 in 0.484s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bedf316-8f77-4071-a5ca-d6998b647a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf9a56-bd0d-4db9-b52d-05bc1211d2e1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-f3600874-e735-4178-a529-663a5b13f0c6-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-f3600874-e735-4178-a529-663a5b13f0c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-quobyte-f3600874-e735-4178-a529-663a5b13f0c6" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-f3600874-e735-4178-a529-663a5b13f0c6" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Deleting offline snapshot f3600874-e735-4178-a529-663a5b13f0c6 of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] snapshot_file for this snap is: volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564d3f8-9708-4a73-8dec-fc86dffed5a6]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:26 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 Apr 13 17:47:26 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:26 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 Apr 13 17:47:26 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:27 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82" returned: 0 in 0.506s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:27 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:47:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:27 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:27 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 Apr 13 17:47:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6" returned: 0 in 0.465s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:27 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:27 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3701ad21-2d11-4492-96e5-127594b13ea6]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:27 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:27 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:28 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.695s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:28 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 Apr 13 17:47:28 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:29 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6" returned: 0 in 1.236s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:29 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9" returned: 0 in 1.970s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8d69e-f0d3-4076-b255-7543ab340936]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:29 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6 Apr 13 17:47:29 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:29 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 Apr 13 17:47:29 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:29 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.f3600874-e735-4178-a529-663a5b13f0c6" returned: 0 in 0.413s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-f3600874-e735-4178-a529-663a5b13f0c6" released by "_delete_snapshot" :: held 2.856s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" released by "delete_snapshot" :: held 2.864s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:UPDATE=221,cinder:SELECT=210,cinder:DELETE=14,cinder:INSERT=65 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Created reservations ['fcabc498-4275-46ee-aafd-6ef92b33efe3', 'c9ccfc9a-c054-4272-9440-330fb5831152', 'd1c15604-b453-44c3-8016-3f56133bc497', 'dedd5d93-9c5e-4832-ae9b-2dd8c54bdb06'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:29 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Delete snapshot completed successfully. Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-54a01998-f4eb-46fc-895e-0aceaf49b989 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-f3600874-e735-4178-a529-663a5b13f0c6-delete_snapshot" released by "delete_snapshot" :: held 2.939s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:29 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82" returned: 0 in 0.581s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82, size 1024.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:47:29 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Converted 1024.00 MB image at 519.36 MB/s Apr 13 17:47:29 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 is being set with open permissions: ugo+rw Apr 13 17:47:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:29 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 Apr 13 17:47:29 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:30 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9" returned: 0 in 0.478s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-96b29586-825d-408b-8b64-76e600fa7df9" released by "_copy_volume_from_snapshot" :: held 4.086s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-4714964a-9b22-4f69-8d65-050b33aab72d-96b29586-825d-408b-8b64-76e600fa7df9" released by "_create_volume_from_snapshot" :: held 4.111s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.138s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.379s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3efdde-1c9e-4f64-9e55-66ac6b87d976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e45c6722c89434dab5024e5f52a2d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:25Z,use_quota=True,user_id='1ad646f315ab45b7aa61ad09ad74eee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Creating volume 9c3efdde-1c9e-4f64-9e55-66ac6b87d976 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:47:30 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:30 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 1073741824 Apr 13 17:47:30 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae154f0-7a97-4b12-b617-2b691c544d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b29586-825d-408b-8b64-76e600fa7df9', 'volume_size': 1, 'snapshot_id': '4714964a-9b22-4f69-8d65-050b33aab72d'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a6ad63-dcdd-44b8-8686-4d86a879437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:30 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Volume volume-96b29586-825d-408b-8b64-76e600fa7df9 (96b29586-825d-408b-8b64-76e600fa7df9): created successfully Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a6ad63-dcdd-44b8-8686-4d86a879437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Flow 'volume_create_manager' (3235427a-fd35-49ed-adc3-075016e11fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:30 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6643ca9e-bbd8-4d69-9e4f-d0ecbc880663 tempest-VolumesDeleteCascade-724339769 None] Created volume successfully. Apr 13 17:47:30 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 1073741824" returned: 0 in 0.569s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:31 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 Apr 13 17:47:31 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-8bedf316-8f77-4071-a5ca-d6998b647a82-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-8bedf316-8f77-4071-a5ca-d6998b647a82-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Performing cascade delete. {{(pid=82736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-4714964a-9b22-4f69-8d65-050b33aab72d-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-4714964a-9b22-4f69-8d65-050b33aab72d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-8bedf316-8f77-4071-a5ca-d6998b647a82" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-8bedf316-8f77-4071-a5ca-d6998b647a82" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-4714964a-9b22-4f69-8d65-050b33aab72d" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-4714964a-9b22-4f69-8d65-050b33aab72d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Deleting offline snapshot 4714964a-9b22-4f69-8d65-050b33aab72d of volume 8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] snapshot_file for this snap is: volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef4c4c0-6cf8-4f8a-b9a5-de08b4230826]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:31 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d Apr 13 17:47:31 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:31 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976" returned: 0 in 0.520s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.217s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06478c31-0a46-49da-b1c8-dd49c6c9a231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365cbfc6-755f-41f4-84d3-e655e4ce69a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Creating offline snapshot e6b08aea-520e-46e8-8041-143794e88c29 of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:31 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Volume volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 (9c3efdde-1c9e-4f64-9e55-66ac6b87d976): created successfully Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365cbfc6-755f-41f4-84d3-e655e4ce69a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Flow 'volume_create_manager' (2fda1e4b-b382-4f7f-bd27-47d0067ff3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[447c65d6-b3e4-40e1-92d0-5f1b594cdffa]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:31 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4d6fcecf-c2b8-4ddf-901e-59929dee6b40 tempest-CinderUnicodeTest-770550540 None] Created volume successfully. Apr 13 17:47:31 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:31 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:31 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d" returned: 0 in 0.610s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bedf316-8f77-4071-a5ca-d6998b647a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e5a47b-1d75-45d4-9032-d7abbd99ae78]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:31 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 Apr 13 17:47:31 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:32 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.511s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:32 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 1G Apr 13 17:47:32 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:32 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82" returned: 0 in 0.620s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:32 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d Apr 13 17:47:32 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:32 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 1G" returned: 0 in 0.627s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:32 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 Apr 13 17:47:32 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Flow 'volume_create_manager' (b3dadd42-04a7-4259-a77f-52ed2c722f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3592ed-a840-4fef-a4b1-080fca85afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3592ed-a840-4fef-a4b1-080fca85afd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-362180346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536d4f80-3b08-447d-ac1b-a1c9de2f60bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e45c6722c89434dab5024e5f52a2d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:33Z,use_quota=True,user_id='1ad646f315ab45b7aa61ad09ad74eee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9659eb6f-7f3a-40af-a8be-6c51da7ab7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9659eb6f-7f3a-40af-a8be-6c51da7ab7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aa0469-a179-4ec6-8fc3-e0b39c71dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aa0469-a179-4ec6-8fc3-e0b39c71dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536d4f80-3b08-447d-ac1b-a1c9de2f60bc', 'volume_name': 'volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb87ae9b-0015-437b-ad77-6601a3f256d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb87ae9b-0015-437b-ad77-6601a3f256d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a33499e-3d62-4f81-90f6-c1668a3cff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:32 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Volume 536d4f80-3b08-447d-ac1b-a1c9de2f60bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc', 'volume_size': 1} Apr 13 17:47:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:33 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d" returned: 0 in 0.555s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:33 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d Apr 13 17:47:33 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:33 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29" returned: 0 in 0.442s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:33 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 is being set with open permissions: ugo+rw Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:33 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 Apr 13 17:47:33 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:33 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82.4714964a-9b22-4f69-8d65-050b33aab72d" returned: 0 in 0.444s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-4714964a-9b22-4f69-8d65-050b33aab72d" released by "_delete_snapshot" :: held 2.287s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-8bedf316-8f77-4071-a5ca-d6998b647a82" released by "delete_snapshot" :: held 2.298s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Created reservations ['d11b384b-2223-40e8-9e90-6e2623c38a1f', 'cc957115-e642-497d-ae01-94378cb57bfe', 'c1c8c13d-5c4c-4e7e-94d7-16dd0838367c', '2f6fb1ed-8674-405f-bc43-556e8e524af6'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:33 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:33 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Delete snapshot completed successfully. Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29" returned: 0 in 0.424s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-4714964a-9b22-4f69-8d65-050b33aab72d-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Snapshots deleted, issuing volume delete {{(pid=82736) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-8bedf316-8f77-4071-a5ca-d6998b647a82" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-362180346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536d4f80-3b08-447d-ac1b-a1c9de2f60bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e45c6722c89434dab5024e5f52a2d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:33Z,use_quota=True,user_id='1ad646f315ab45b7aa61ad09ad74eee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Creating volume 536d4f80-3b08-447d-ac1b-a1c9de2f60bc {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:47:33 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-8bedf316-8f77-4071-a5ca-d6998b647a82" acquired by "delete_volume" :: waited 0.048s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:33 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc 1073741824 Apr 13 17:47:33 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5008fc34-e975-4e28-a10f-192b48dc34b2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:33 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ef460046-c522-44e2-872b-f91ce9daf20a tempest-SnapshotsActionsTest-401054584 None] Create snapshot completed successfully Apr 13 17:47:33 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 Apr 13 17:47:33 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:34 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc 1073741824" returned: 0 in 0.535s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:34 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc Apr 13 17:47:34 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:34 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82" returned: 0 in 0.555s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:34 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82 Apr 13 17:47:34 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-e6b08aea-520e-46e8-8041-143794e88c29-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-e6b08aea-520e-46e8-8041-143794e88c29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-quobyte-e6b08aea-520e-46e8-8041-143794e88c29" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e6b08aea-520e-46e8-8041-143794e88c29" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Deleting offline snapshot e6b08aea-520e-46e8-8041-143794e88c29 of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] snapshot_file for this snap is: volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f522418-807f-4923-9081-1e939881d087]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:34 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" returned: 0 in 0.425s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a33499e-3d62-4f81-90f6-c1668a3cff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b48c3c0-5dfa-4b0c-99c0-24555d857fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:34 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 Apr 13 17:47:34 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:34 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Volume volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc (536d4f80-3b08-447d-ac1b-a1c9de2f60bc): created successfully Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b48c3c0-5dfa-4b0c-99c0-24555d857fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Flow 'volume_create_manager' (b3dadd42-04a7-4259-a77f-52ed2c722f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:34 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d005ef04-c562-40c0-8f2c-4b62f9b2d4c7 tempest-CinderUnicodeTest-770550540 None] Created volume successfully. Apr 13 17:47:34 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8bedf316-8f77-4071-a5ca-d6998b647a82" returned: 0 in 0.458s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-8bedf316-8f77-4071-a5ca-d6998b647a82" released by "delete_volume" :: held 1.044s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Created reservations ['51ee9430-2f1e-44dc-a559-b84e288753c3', 'f7195264-e38f-48ef-a0b6-a18ca459ad80', 'f869a039-7914-4daf-8a90-7a0e7b4dc50b', '9df2d811-b770-407a-b323-40a53215110b'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:34 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:34 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Creating offline snapshot 63aef1ff-40a0-46a8-b194-3f1a665e919b of volume 536d4f80-3b08-447d-ac1b-a1c9de2f60bc {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b90a21a-0399-4d8e-807e-b8164393e1c3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:35 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29" returned: 0 in 0.582s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be5697-aaed-4402-b900-90d7d87d46a6]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:35 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc Apr 13 17:47:35 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:35 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:35 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:35 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.472s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Deleted volume successfully. Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-41bf3a4e-6a05-4376-a2c3-8d85302108ca tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-8bedf316-8f77-4071-a5ca-d6998b647a82-delete_volume" released by "delete_volume" :: held 4.120s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-96b29586-825d-408b-8b64-76e600fa7df9-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-96b29586-825d-408b-8b64-76e600fa7df9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "cinder-quobyte-96b29586-825d-408b-8b64-76e600fa7df9" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-96b29586-825d-408b-8b64-76e600fa7df9" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a208dd09-9cf1-455d-9a02-e1fe8b6b659d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:35 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:35 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" returned: 0 in 0.573s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.527s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:35 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b 1G Apr 13 17:47:35 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:35 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 Apr 13 17:47:35 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:35 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 Apr 13 17:47:35 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:36 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9" returned: 0 in 0.529s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:36 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9 Apr 13 17:47:36 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:36 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29" returned: 0 in 0.514s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:36 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b 1G" returned: 0 in 0.540s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:36 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29 Apr 13 17:47:36 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:36 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b Apr 13 17:47:36 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:36 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.e6b08aea-520e-46e8-8041-143794e88c29" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:36 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e6b08aea-520e-46e8-8041-143794e88c29" released by "_delete_snapshot" :: held 2.210s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" released by "delete_snapshot" :: held 2.227s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=202,cinder:INSERT=55,cinder:UPDATE=245,cinder:DELETE=20 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-96b29586-825d-408b-8b64-76e600fa7df9" returned: 0 in 0.600s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-quobyte-96b29586-825d-408b-8b64-76e600fa7df9" released by "delete_volume" :: held 1.162s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Created reservations ['17b130b9-133d-4e12-a4ec-97b9275329f1', 'ab5c03fe-1d58-4a05-9ad7-e68f69cf1d94', 'e8222ff0-fdd3-4d70-a10e-4ff40eb21e10', 'd8124670-420c-4f07-a79d-5088c12ab4b0'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:36 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:36 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Created reservations ['d90bd875-2570-4664-9960-182e36fd3bfa', 'c96f8dd0-b6f9-4137-a4b5-98ed3a0678d1', 'be8b24e4-8b98-443e-bf55-a2f054dae9cf', 'da72718d-5964-4c03-b0c4-4824e6793df6'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b" returned: 0 in 0.751s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:37 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b is being set with open permissions: ugo+rw Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:37 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b Apr 13 17:47:37 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Delete snapshot completed successfully. Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3bea9ea4-c99e-4daf-9d0b-ff6ae11e71de tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-e6b08aea-520e-46e8-8041-143794e88c29-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:37 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:37 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:37 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b" returned: 0 in 0.512s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:37 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.info Apr 13 17:47:37 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:37 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.512s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Deleted volume successfully. Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8055a1bb-b5dd-4e39-95de-3d5635ab69f8 tempest-VolumesDeleteCascade-724339769 None] Lock "cinder-96b29586-825d-408b-8b64-76e600fa7df9-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:38 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.info" returned: 0 in 0.503s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:38 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.info is being set with open permissions: ugo+rw Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:38 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.info Apr 13 17:47:38 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:38 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.info" returned: 0 in 0.502s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.461s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.639s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Creating offline snapshot 9c0492f2-6952-49aa-abf1-57dfb43ed41a of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-48887336-9e80-47c6-81d3-9bfd3f7339ad tempest-CinderUnicodeTest-770550540 None] Create snapshot completed successfully Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d084e-1ca2-4837-be44-e1fb9f044b2f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:38 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:38 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-532b969d-2034-4bb6-bd7f-a19f4b2aab0a tempest-VolumesActionsTest-205723266 None] Acquiring lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52" by "attach_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-532b969d-2034-4bb6-bd7f-a19f4b2aab0a tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52" acquired by "attach_volume" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-532b969d-2034-4bb6-bd7f-a19f4b2aab0a tempest-VolumesActionsTest-205723266 None] Attaching volume becb4234-4063-4f8d-a3a5-154749f91a52 to instance 516c85cd-a17f-4d94-99af-b8a0445818da at mountpoint /dev/vdb on host None. Apr 13 17:47:39 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-532b969d-2034-4bb6-bd7f-a19f4b2aab0a tempest-VolumesActionsTest-205723266 None] Attach volume completed successfully. Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-532b969d-2034-4bb6-bd7f-a19f4b2aab0a tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52" released by "attach_volume" :: held 0.109s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:39 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.542s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:39 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a 1G Apr 13 17:47:39 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "cinder-63aef1ff-40a0-46a8-b194-3f1a665e919b-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-63aef1ff-40a0-46a8-b194-3f1a665e919b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "cinder-quobyte-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-quobyte-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "cinder-quobyte-63aef1ff-40a0-46a8-b194-3f1a665e919b" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-quobyte-63aef1ff-40a0-46a8-b194-3f1a665e919b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Deleting offline snapshot 63aef1ff-40a0-46a8-b194-3f1a665e919b of volume 536d4f80-3b08-447d-ac1b-a1c9de2f60bc {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] snapshot_file for this snap is: volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f60bd01-1a95-45d4-aeac-9f9c85f12f5b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:39 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b Apr 13 17:47:39 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-45a9ca57-aff5-45d3-b3f7-078bb98619c6 tempest-VolumesActionsTest-205723266 None] Acquiring lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-detach_volume" by "detach_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-45a9ca57-aff5-45d3-b3f7-078bb98619c6 tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:39 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-45a9ca57-aff5-45d3-b3f7-078bb98619c6 tempest-VolumesActionsTest-205723266 None] Detaching volume becb4234-4063-4f8d-a3a5-154749f91a52 from instance 516c85cd-a17f-4d94-99af-b8a0445818da. Apr 13 17:47:39 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-45a9ca57-aff5-45d3-b3f7-078bb98619c6 tempest-VolumesActionsTest-205723266 None] Detach volume completed successfully. Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-45a9ca57-aff5-45d3-b3f7-078bb98619c6 tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:39 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a 1G" returned: 0 in 0.676s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:39 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a Apr 13 17:47:39 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:47:40 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Flow 'volume_create_manager' (49bda666-8712-49f1-b27c-9733fc8110a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c737222-445c-4dd3-b703-ed0e0ceabf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b" returned: 0 in 0.690s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6595245b-62d6-4435-8d86-045fc9d2ecc1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c737222-445c-4dd3-b703-ed0e0ceabf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-739376720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbd4ab0-e51b-4e35-96ce-082a6346d9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153656b28c454cff85a64f49b18aec23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:40Z,use_quota=True,user_id='8790f3e37f014dd1bb0ce7703af8a8f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa6b6ba-3b72-4887-8246-f4bee56ae34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa6b6ba-3b72-4887-8246-f4bee56ae34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91cac9b-a4e0-43a6-ab7c-12390e3f3ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91cac9b-a4e0-43a6-ab7c-12390e3f3ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbd4ab0-e51b-4e35-96ce-082a6346d9b9', 'volume_name': 'volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fc201c-9349-4f23-8b55-522585875bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4fc201c-9349-4f23-8b55-522585875bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd71ce5b-99b8-4c4a-ae18-2ed3db819f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:40 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Volume afbd4ab0-e51b-4e35-96ce-082a6346d9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9', 'volume_size': 1} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:40 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc Apr 13 17:47:40 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:40 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a" returned: 0 in 0.591s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:40 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a is being set with open permissions: ugo+rw Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:40 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a Apr 13 17:47:40 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:40 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" returned: 0 in 0.567s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:40 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b Apr 13 17:47:40 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:40 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a" returned: 0 in 0.415s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-739376720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbd4ab0-e51b-4e35-96ce-082a6346d9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153656b28c454cff85a64f49b18aec23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:40Z,use_quota=True,user_id='8790f3e37f014dd1bb0ce7703af8a8f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Creating volume afbd4ab0-e51b-4e35-96ce-082a6346d9b9 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:47:40 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:47:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:40 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 1073741824 Apr 13 17:47:40 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:40 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-0e2481c2-f88a-4f2b-8445-01aca59eed5f tempest-SnapshotsActionsTest-401054584 None] Create snapshot completed successfully Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-9c0492f2-6952-49aa-abf1-57dfb43ed41a-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-9c0492f2-6952-49aa-abf1-57dfb43ed41a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-quobyte-9c0492f2-6952-49aa-abf1-57dfb43ed41a" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-9c0492f2-6952-49aa-abf1-57dfb43ed41a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Deleting offline snapshot 9c0492f2-6952-49aa-abf1-57dfb43ed41a of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] snapshot_file for this snap is: volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb01113d-76b9-4af8-a030-446c0b74a351]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:41 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b" returned: 0 in 0.602s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:41 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b Apr 13 17:47:41 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:41 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a Apr 13 17:47:41 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:41 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 1073741824" returned: 0 in 0.655s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:41 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 Apr 13 17:47:41 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:41 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a" returned: 0 in 0.579s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbf3f71-2ea0-46e3-87f5-33a43c9445cb]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:41 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc.63aef1ff-40a0-46a8-b194-3f1a665e919b" returned: 0 in 0.634s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:41 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:41 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-quobyte-63aef1ff-40a0-46a8-b194-3f1a665e919b" released by "_delete_snapshot" :: held 2.563s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-quobyte-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" released by "delete_snapshot" :: held 2.575s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:41 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Created reservations ['c5155afd-08f2-4bd7-a5bc-49d7ed058d2f', 'accf9796-37ee-4d62-b5dd-d1c3665b7c54', '7f27ccee-d5de-4e52-bbb0-43e1b1fee986', '4fe3c21f-6550-4879-8772-6d077c2e3233'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:42 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Delete snapshot completed successfully. Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-12f1ff43-e766-4f8f-89f3-4fe78aea5d61 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-63aef1ff-40a0-46a8-b194-3f1a665e919b-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:42 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9" returned: 0 in 0.500s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd71ce5b-99b8-4c4a-ae18-2ed3db819f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e9a865-c355-4c02-9d89-77ca9e2e5907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:42 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Volume volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 (afbd4ab0-e51b-4e35-96ce-082a6346d9b9): created successfully Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e9a865-c355-4c02-9d89-77ca9e2e5907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Flow 'volume_create_manager' (49bda666-8712-49f1-b27c-9733fc8110a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:42 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f10cadbb-788e-447a-9e42-8c582d90ca9e tempest-VolumesMetadataTest-1820600476 None] Created volume successfully. Apr 13 17:47:42 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.510s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:42 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a Apr 13 17:47:42 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "cinder-536d4f80-3b08-447d-ac1b-a1c9de2f60bc-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-536d4f80-3b08-447d-ac1b-a1c9de2f60bc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "cinder-quobyte-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-quobyte-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd158d1f-2561-431e-aa29-a6d92687b355]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:42 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc Apr 13 17:47:42 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:42 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a" returned: 0 in 0.515s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:42 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a Apr 13 17:47:42 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:43 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" returned: 0 in 0.562s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:43 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc Apr 13 17:47:43 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:43 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.9c0492f2-6952-49aa-abf1-57dfb43ed41a" returned: 0 in 0.469s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-9c0492f2-6952-49aa-abf1-57dfb43ed41a" released by "_delete_snapshot" :: held 2.131s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" released by "delete_snapshot" :: held 2.143s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Created reservations ['a45cf0be-18a9-4718-afc1-ef2d2a652a0b', '67d3bfb2-408a-4940-979a-d9fc86dca497', '50f700ec-445b-45be-8fe4-4b9dcd19f27a', '4be02e44-075d-41fb-a855-ac1b38297174'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:43 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Delete snapshot completed successfully. Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-561e9363-b210-4b6b-8c9d-5f6af74cb6b2 tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-9c0492f2-6952-49aa-abf1-57dfb43ed41a-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:43 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" returned: 0 in 0.482s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-quobyte-536d4f80-3b08-447d-ac1b-a1c9de2f60bc" released by "delete_volume" :: held 1.070s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Created reservations ['74c2c1bb-98ae-4275-82cf-f2536655b70d', '0b33e87d-2735-4aff-bc65-d9f7852a1184', 'f27f2bd1-3676-4ec2-bd07-a02f6e03ae21', '436cd28d-41d7-4ee3-a78c-016b14b101b2'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:43 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:43 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Acquiring lock "cinder-afbd4ab0-e51b-4e35-96ce-082a6346d9b9-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Lock "cinder-afbd4ab0-e51b-4e35-96ce-082a6346d9b9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Acquiring lock "cinder-quobyte-afbd4ab0-e51b-4e35-96ce-082a6346d9b9" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Lock "cinder-quobyte-afbd4ab0-e51b-4e35-96ce-082a6346d9b9" acquired by "delete_volume" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[92286fc6-04ba-47bf-8638-c080649ecbd8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:43 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 Apr 13 17:47:43 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:44 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.436s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:44 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Deleted volume successfully. Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f83d67d4-e017-4937-aac7-efa93d667297 tempest-CinderUnicodeTest-770550540 None] Lock "cinder-536d4f80-3b08-447d-ac1b-a1c9de2f60bc-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:44 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9" returned: 0 in 0.474s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:44 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9 Apr 13 17:47:44 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Creating offline snapshot d970945c-57d5-4fa1-b28e-6d57cd7043ec of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e943ca7-1962-44e1-8018-679568fa4885]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:44 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:44 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Acquiring lock "cinder-9c3efdde-1c9e-4f64-9e55-66ac6b87d976-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Lock "cinder-9c3efdde-1c9e-4f64-9e55-66ac6b87d976-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:44 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-afbd4ab0-e51b-4e35-96ce-082a6346d9b9" returned: 0 in 0.461s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Acquiring lock "cinder-quobyte-9c3efdde-1c9e-4f64-9e55-66ac6b87d976" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Lock "cinder-quobyte-afbd4ab0-e51b-4e35-96ce-082a6346d9b9" released by "delete_volume" :: held 0.957s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Lock "cinder-quobyte-9c3efdde-1c9e-4f64-9e55-66ac6b87d976" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642f663-b536-427f-8b15-8c334f02e01f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Created reservations ['2610dc0c-bd8c-4322-a242-72ce6c13badf', '14ca706c-ad7d-4fd2-867f-e41f9f1a1e49', 'dad99d36-f503-4156-a611-b66e06792502', '9e1d7687-370d-485e-b2c5-7eb45e220a29'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:44 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 Apr 13 17:47:44 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:44 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:44 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:45 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.513s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:45 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec 1G Apr 13 17:47:45 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:45 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976" returned: 0 in 0.498s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:45 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976 Apr 13 17:47:45 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:45 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.461s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:45 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Deleted volume successfully. Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-6a1b6c85-a3a9-47a8-b979-3cd3978b14e0 tempest-VolumesMetadataTest-1820600476 None] Lock "cinder-afbd4ab0-e51b-4e35-96ce-082a6346d9b9-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:45 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec 1G" returned: 0 in 0.527s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:45 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec Apr 13 17:47:45 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:45 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9c3efdde-1c9e-4f64-9e55-66ac6b87d976" returned: 0 in 0.463s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Lock "cinder-quobyte-9c3efdde-1c9e-4f64-9e55-66ac6b87d976" released by "delete_volume" :: held 0.983s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Created reservations ['5fc21d8b-e78e-4a9c-861e-f89b07bd1ca0', '7e04db5e-cc0d-425c-94e9-67119c7aa3cb', '6e7c840a-345a-4bc6-a004-b17de565e0dc', 'd6c76569-da65-4c6c-a627-f14fd3c86fcc'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:45 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:45 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:46 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec" returned: 0 in 0.559s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:46 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec is being set with open permissions: ugo+rw Apr 13 17:47:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:46 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec Apr 13 17:47:46 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:46 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.448s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:46 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:46 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Deleted volume successfully. Apr 13 17:47:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-fc942a5d-5145-4fe1-bf2a-51d2a2b0afcd tempest-CinderUnicodeTest-770550540 None] Lock "cinder-9c3efdde-1c9e-4f64-9e55-66ac6b87d976-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:46 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec" returned: 0 in 0.520s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:46 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-421d9cb9-b0e0-408b-8be3-6196fe2f543b tempest-SnapshotsActionsTest-401054584 None] Create snapshot completed successfully Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcac70a5-752e-4c0b-984d-b0e24bc953f2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-d970945c-57d5-4fa1-b28e-6d57cd7043ec-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-d970945c-57d5-4fa1-b28e-6d57cd7043ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Acquiring lock "cinder-quobyte-d970945c-57d5-4fa1-b28e-6d57cd7043ec" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:47 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:47:47 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-d970945c-57d5-4fa1-b28e-6d57cd7043ec" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Deleting offline snapshot d970945c-57d5-4fa1-b28e-6d57cd7043ec of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] snapshot_file for this snap is: volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cd0367-0427-4655-a505-ffea337fb8f1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:47 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec Apr 13 17:47:47 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:48 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.606s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb8b13c-387b-4291-b32c-add5340a8a46]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:48 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:47:48 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:48 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec" returned: 0 in 0.595s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4caa7b-8926-4c78-9b8d-f99bc9dfea3f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:48 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:48 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:48 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.554s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.26b3c326-7bb5-4e33-ac99-46c1921ee6cc8yn7sezr.img {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:48 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.26b3c326-7bb5-4e33-ac99-46c1921ee6cc8yn7sezr.img Apr 13 17:47:48 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Flow 'volume_create_manager' (0c5302b5-b90f-4713-9178-80ec1e89e0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3481526-59af-4e0f-85c2-aa14295d6959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3481526-59af-4e0f-85c2-aa14295d6959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-754348758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf921d0a-2497-4a42-a144-22e9a15ba9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f37eef0cac348f4889c5955853d678a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:49Z,use_quota=True,user_id='65528fb13e6b48f4b46bbe5a4429cd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4619d85c-00c2-440c-b324-ccdbe29522de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4619d85c-00c2-440c-b324-ccdbe29522de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0326427-a10d-4136-b65a-898402d3ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0326427-a10d-4136-b65a-898402d3ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf921d0a-2497-4a42-a144-22e9a15ba9b0', 'volume_name': 'volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500ec4f2-2368-4f91-a1d7-c78207ff5f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500ec4f2-2368-4f91-a1d7-c78207ff5f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff89a968-525c-4d91-b348-c557b62ab49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:47:48 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Volume cf921d0a-2497-4a42-a144-22e9a15ba9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0', 'volume_size': 1} Apr 13 17:47:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:49 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.633s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:49 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec Apr 13 17:47:49 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:50 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec" returned: 0 in 1.020s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:50 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec Apr 13 17:47:50 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:51 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.d970945c-57d5-4fa1-b28e-6d57cd7043ec" returned: 0 in 0.953s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-d970945c-57d5-4fa1-b28e-6d57cd7043ec" released by "_delete_snapshot" :: held 3.266s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" released by "delete_snapshot" :: held 3.279s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:51 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.26b3c326-7bb5-4e33-ac99-46c1921ee6cc8yn7sezr.img" returned: 0 in 2.265s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Created reservations ['c0b6017a-513c-45d8-ba98-f4a6edf0299b', '99aa5754-d29e-40f5-8e66-69c89d191810', '96a4f716-6a9b-47ab-9987-c0cc31249600', 'b4c9f60a-7ffb-4388-99d6-dcfa1e1b1e1c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e35a7-ca8f-467c-badd-74fdd8998daa]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:51 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Delete snapshot completed successfully. Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4fad48ea-5904-492d-a231-7cae1a75bb0b tempest-SnapshotsActionsTest-468771287 None] Lock "cinder-d970945c-57d5-4fa1-b28e-6d57cd7043ec-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:51 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:47:51 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:51 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.638s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.26b3c326-7bb5-4e33-ac99-46c1921ee6cc8yn7sezr.img {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:47:51 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Converted 1024.00 MB image at 451.80 MB/s Apr 13 17:47:51 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] 26b3c326-7bb5-4e33-ac99-46c1921ee6cc was raw, no need to convert to raw {{(pid=82736) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "cinder-901848f4-3d23-4486-8ce0-55c657784fa2-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-901848f4-3d23-4486-8ce0-55c657784fa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "cinder-quobyte-901848f4-3d23-4486-8ce0-55c657784fa2" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-quobyte-901848f4-3d23-4486-8ce0-55c657784fa2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Deleting offline snapshot 901848f4-3d23-4486-8ce0-55c657784fa2 of volume e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] snapshot_file for this snap is: volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c18947e-c39e-41e0-a4ad-db68647fb2b4]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:52 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:52 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:53 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.637s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:47:53 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17193f0-eeec-4ebd-8dd7-5109db03705f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:53 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 Apr 13 17:47:53 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:53 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" returned: 0 in 0.483s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:53 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:53 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:54 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.627s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:54 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2 Apr 13 17:47:54 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:54 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01.901848f4-3d23-4486-8ce0-55c657784fa2" returned: 0 in 0.624s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-quobyte-901848f4-3d23-4486-8ce0-55c657784fa2" released by "_delete_snapshot" :: held 2.445s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" released by "delete_snapshot" :: held 2.462s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:54 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Created reservations ['5df7f6a2-bbab-419d-9ea4-ea0b601cc77e', 'cd51d745-8004-4c8b-8ab4-db569e79f883', '0f937d4a-16fb-4dc9-8daa-7b510812faf8', 'a22eee9f-d2f6-4b25-ad74-ce7861b30657'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:54 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Delete snapshot completed successfully. Apr 13 17:47:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b90c2217-a4d6-4ea6-93c8-f9631565502b tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-901848f4-3d23-4486-8ce0-55c657784fa2-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "cinder-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:47:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:47:55 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca997b-cba5-4a5b-8634-af142b4ff9c3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:47:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:55 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 Apr 13 17:47:55 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:56 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" returned: 0 in 0.736s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:56 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01 Apr 13 17:47:56 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:56 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" returned: 0 in 0.553s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:56 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-quobyte-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01" released by "delete_volume" :: held 1.326s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:47:56 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Created reservations ['c6e2cc00-6c61-463d-b1d2-cdfebf56d8fe', '7153bd08-f560-4aaf-85a8-0e9b4f9052bb', '72485897-08ce-45ed-8a06-e7ebd33639ef', 'b83425a1-b82f-4d8a-9a06-19dce1fd2587'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:47:57 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:47:57 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:47:57 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.585s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:47:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Deleted volume successfully. Apr 13 17:47:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ba64aa61-f407-404a-916c-de43bf1e8dd7 tempest-SnapshotsActionsTest-401054584 None] Lock "cinder-e25bc9d3-df15-41b5-b22e-b7b4a2de3b01-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.376s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Uploaded volume to glance image-id: 26b3c326-7bb5-4e33-ac99-46c1921ee6cc. {{(pid=82736) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.051s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-754348758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf921d0a-2497-4a42-a144-22e9a15ba9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f37eef0cac348f4889c5955853d678a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:47:49Z,use_quota=True,user_id='65528fb13e6b48f4b46bbe5a4429cd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Creating volume cf921d0a-2497-4a42-a144-22e9a15ba9b0 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:03 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:03 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 1073741824 Apr 13 17:48:03 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:03 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b351a54b-854f-4250-aad3-805562d36b49 tempest-VolumesActionsTest-205723266 None] Copy volume to image completed successfully. Apr 13 17:48:03 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 1073741824" returned: 0 in 0.750s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:03 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 Apr 13 17:48:03 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:04 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0" returned: 0 in 0.583s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff89a968-525c-4d91-b348-c557b62ab49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33059752-e281-4245-b5fb-5591ff76953d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:04 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Volume volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 (cf921d0a-2497-4a42-a144-22e9a15ba9b0): created successfully Apr 13 17:48:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33059752-e281-4245-b5fb-5591ff76953d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Flow 'volume_create_manager' (0c5302b5-b90f-4713-9178-80ec1e89e0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:04 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-11295e1c-9393-4bcc-83b9-4952fd2f3c38 tempest-VolumesTransfersTest-422349476 None] Created volume successfully. Apr 13 17:48:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:05 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93cb83b-2aed-43e8-8766-3d8b5cd1733c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:05 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:48:05 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:05 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-9007d861-83e8-407b-b58d-935420c29e07 tempest-VolumesTransfersTest-48711595 None] Transfer volume completed successfully. Apr 13 17:48:05 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.904s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:05 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb6fa97-ca24-490f-96e7-cedcfb64c258]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:06 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:48:06 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Acquiring lock "cinder-cf921d0a-2497-4a42-a144-22e9a15ba9b0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Lock "cinder-cf921d0a-2497-4a42-a144-22e9a15ba9b0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:06 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Acquiring lock "cinder-quobyte-cf921d0a-2497-4a42-a144-22e9a15ba9b0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.707s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Lock "cinder-quobyte-cf921d0a-2497-4a42-a144-22e9a15ba9b0" acquired by "delete_volume" :: waited 0.029s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:06 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f17fe-9086-471d-ae70-fa6469be1b00]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:06 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img Apr 13 17:48:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:06 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:06 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 Apr 13 17:48:06 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:07 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0" returned: 0 in 0.579s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:07 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0 Apr 13 17:48:07 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:09 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf921d0a-2497-4a42-a144-22e9a15ba9b0" returned: 0 in 1.855s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:09 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Flow 'volume_create_manager' (9e0a6b4d-e15a-4086-adf6-6436183fffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1079e8-362b-43e1-832d-13b4904a24cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Lock "cinder-quobyte-cf921d0a-2497-4a42-a144-22e9a15ba9b0" released by "delete_volume" :: held 2.494s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img" returned: 0 in 2.521s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1079e8-362b-43e1-832d-13b4904a24cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-843618498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef37e851-2876-4c87-ad09-96543c9810df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74a349002c142dfa4b0fd79fc31bf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:09Z,use_quota=True,user_id='b6776105ec1b4cc2aa188ee9a7e6587c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01358fb1-2479-464c-84a1-bd8c8ab5c0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01358fb1-2479-464c-84a1-bd8c8ab5c0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b4373d-0d7c-4d15-b990-2f7892d61013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b4373d-0d7c-4d15-b990-2f7892d61013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef37e851-2876-4c87-ad09-96543c9810df', 'volume_name': 'volume-ef37e851-2876-4c87-ad09-96543c9810df', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b43a02-eda4-4a32-b3e3-eb6c0d41630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b43a02-eda4-4a32-b3e3-eb6c0d41630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c71e2ca-d6d2-4326-a58b-bbf9fc69c312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Volume ef37e851-2876-4c87-ad09-96543c9810df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef37e851-2876-4c87-ad09-96543c9810df', 'volume_size': 1} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984ee8f-7cc4-4f8e-a957-6502950636df]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Created reservations ['49ef7922-8b4d-4340-ae64-8bae6a91fab7', 'da9d71b6-ebcc-45e0-9c3f-56437d1dd370', '79cacd2b-a125-448c-9bb1-d6d417982355', 'd26f6f82-86d6-4fd6-a10c-5278306684ca'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:09 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:48:09 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:09 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:09 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Flow 'volume_create_manager' (c7ccb80e-3b0d-4316-b0ec-932ecc98084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8937c0f-8369-43f2-ba8f-9470b180d6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8937c0f-8369-43f2-ba8f-9470b180d6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-937068204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d810ce5b-b891-42c7-95ab-79f3a710888e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0132b3ffb7d74719b2e24ca7e3e5e5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:10Z,use_quota=True,user_id='b7943a8fec4a4e90b80dde83631a3e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f775ba5-7dc9-40cb-8829-7ed957fa41c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f775ba5-7dc9-40cb-8829-7ed957fa41c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df0dee6-afb9-4350-b34b-2d3fcccc90e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df0dee6-afb9-4350-b34b-2d3fcccc90e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd810ce5b-b891-42c7-95ab-79f3a710888e', 'volume_name': 'volume-d810ce5b-b891-42c7-95ab-79f3a710888e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d9ffa1-2fec-4bef-bad9-99666cb87f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d9ffa1-2fec-4bef-bad9-99666cb87f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e583ab-49f2-4b42-81db-05ef271edc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:09 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Volume d810ce5b-b891-42c7-95ab-79f3a710888e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d810ce5b-b891-42c7-95ab-79f3a710888e', 'volume_size': 1} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:09 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.517s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:09 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:09 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:09 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Deleted volume successfully. Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-88cc92dd-8f8a-48f1-972b-9934144e8007 tempest-VolumesTransfersTest-1047046181 None] Lock "cinder-cf921d0a-2497-4a42-a144-22e9a15ba9b0-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:09 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.692s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:48:09 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Converted 1024.00 MB image at 405.31 MB/s Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] c1277ca0-4129-49e2-bd21-bcc4a0e8ad50 was raw, converting to qcow2 {{(pid=82736) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[48acb4c1-04be-418d-8c61-6923ceac6b1b]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:10 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img Apr 13 17:48:10 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:10 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.477s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Flow 'volume_create_manager' (5c6ed2b8-fc82-4122-a394-5f560dfb4118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752fcfb4-5fde-4fda-b92d-dc2675f5ebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752fcfb4-5fde-4fda-b92d-dc2675f5ebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2097045507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95684722-4712-4042-a2f5-a6bc10d54ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f37eef0cac348f4889c5955853d678a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:10Z,use_quota=True,user_id='65528fb13e6b48f4b46bbe5a4429cd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8cc2db-6daa-4e66-86eb-20d59f1d16f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8cc2db-6daa-4e66-86eb-20d59f1d16f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185c1253-87ce-42de-afe0-6a9adbeb22fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185c1253-87ce-42de-afe0-6a9adbeb22fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95684722-4712-4042-a2f5-a6bc10d54ca5', 'volume_name': 'volume-95684722-4712-4042-a2f5-a6bc10d54ca5', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97d9185-0a37-4b1d-924c-44f88b94eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97d9185-0a37-4b1d-924c-44f88b94eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10259997-c162-4c27-b31b-a3d6f216c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:10 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Volume 95684722-4712-4042-a2f5-a6bc10d54ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95684722-4712-4042-a2f5-a6bc10d54ca5', 'volume_size': 1} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:10 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img" returned: 0 in 0.514s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:10 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img Apr 13 17:48:10 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:10 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img" returned: 1 in 0.431s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:48:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img /opt/stack/data/cinder/conversion/vol_upload_splfnwm2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:10 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img /opt/stack/data/cinder/conversion/vol_upload_splfnwm2 Apr 13 17:48:10 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:11 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img /opt/stack/data/cinder/conversion/vol_upload_splfnwm2" returned: 0 in 0.422s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:11 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Image conversion details: src /opt/stack/data/cinder/conversion/becb4234-4063-4f8d-a3a5-154749f91a52.temp_image.c1277ca0-4129-49e2-bd21-bcc4a0e8ad50d0p3t1xq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_splfnwm2 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:48:11 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 13 17:48:11 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a897a-cbc3-4390-a43f-1d2fe8abf356]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_splfnwm2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:11 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_splfnwm2 Apr 13 17:48:11 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:11 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_splfnwm2" returned: 0 in 0.431s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.536s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Uploaded volume to glance image-id: c1277ca0-4129-49e2-bd21-bcc4a0e8ad50. {{(pid=82736) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.329s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-843618498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef37e851-2876-4c87-ad09-96543c9810df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74a349002c142dfa4b0fd79fc31bf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:09Z,use_quota=True,user_id='b6776105ec1b4cc2aa188ee9a7e6587c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Creating volume ef37e851-2876-4c87-ad09-96543c9810df {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:12 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:12 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df 1073741824 Apr 13 17:48:12 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:12 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6cbd5dec-d154-4f16-b41d-ff472c8ef9b4 tempest-VolumesActionsTest-205723266 None] Copy volume to image completed successfully. Apr 13 17:48:13 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df 1073741824" returned: 0 in 0.452s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:13 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df Apr 13 17:48:13 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:13 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df" returned: 0 in 0.441s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.872s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-937068204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d810ce5b-b891-42c7-95ab-79f3a710888e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0132b3ffb7d74719b2e24ca7e3e5e5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:10Z,use_quota=True,user_id='b7943a8fec4a4e90b80dde83631a3e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Creating volume d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:13 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c71e2ca-d6d2-4326-a58b-bbf9fc69c312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef37e851-2876-4c87-ad09-96543c9810df', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:13 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e 1073741824 Apr 13 17:48:13 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b30bb0c-a0a5-48b0-ae16-f81a31462e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:13 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Volume volume-ef37e851-2876-4c87-ad09-96543c9810df (ef37e851-2876-4c87-ad09-96543c9810df): created successfully Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b30bb0c-a0a5-48b0-ae16-f81a31462e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Flow 'volume_create_manager' (9e0a6b4d-e15a-4086-adf6-6436183fffd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:13 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-75f80aa2-80d2-436e-9b62-4b70e72ed709 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Created volume successfully. Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Acquiring lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Acquiring lock "cinder-quobyte-becb4234-4063-4f8d-a3a5-154749f91a52" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Lock "cinder-quobyte-becb4234-4063-4f8d-a3a5-154749f91a52" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae1cbc1-dff3-4f75-9ffa-8e80a89f3f7e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:13 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:48:13 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:13 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e 1073741824" returned: 0 in 0.495s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:14 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e Apr 13 17:48:14 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:14 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.481s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:14 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52 Apr 13 17:48:14 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:14 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e" returned: 0 in 0.448s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.053s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2097045507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95684722-4712-4042-a2f5-a6bc10d54ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f37eef0cac348f4889c5955853d678a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:10Z,use_quota=True,user_id='65528fb13e6b48f4b46bbe5a4429cd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Creating volume 95684722-4712-4042-a2f5-a6bc10d54ca5 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:14 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e583ab-49f2-4b42-81db-05ef271edc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d810ce5b-b891-42c7-95ab-79f3a710888e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0fed44-e50d-4fac-9edc-30b60f5a49d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:14 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 1073741824 Apr 13 17:48:14 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:14 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Volume volume-d810ce5b-b891-42c7-95ab-79f3a710888e (d810ce5b-b891-42c7-95ab-79f3a710888e): created successfully Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0fed44-e50d-4fac-9edc-30b60f5a49d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Flow 'volume_create_manager' (c7ccb80e-3b0d-4316-b0ec-932ecc98084a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Acquiring lock "cinder-ef37e851-2876-4c87-ad09-96543c9810df-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:14 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-bab0e8de-5fe4-412e-8c4e-7e53794de8f2 tempest-SnapshotDependencyTests-757100749 None] Created volume successfully. Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "cinder-ef37e851-2876-4c87-ad09-96543c9810df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Acquiring lock "cinder-quobyte-ef37e851-2876-4c87-ad09-96543c9810df" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "cinder-quobyte-ef37e851-2876-4c87-ad09-96543c9810df" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bded78-4180-4b31-9ce1-a33d9aaf15f1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:14 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df Apr 13 17:48:14 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:14 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-becb4234-4063-4f8d-a3a5-154749f91a52" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Lock "cinder-quobyte-becb4234-4063-4f8d-a3a5-154749f91a52" released by "delete_volume" :: held 0.965s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Created reservations ['fcdff8c9-1765-45f1-9f79-99e43afed9fc', '3e83bfad-fe64-4e41-9126-f86adfb6ba76', '54f23f40-8fc4-4029-94a4-f2690acbf014', '790f7832-30ec-4ae2-86bd-c9bf316e2367'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:14 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:14 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:15 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 1073741824" returned: 0 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:15 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 Apr 13 17:48:15 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:15 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df" returned: 0 in 0.555s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:15 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df Apr 13 17:48:15 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:15 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.475s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:15 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Deleted volume successfully. Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dbb699c3-f67d-4088-aa31-f65507746bb0 tempest-VolumesActionsTest-205723266 None] Lock "cinder-becb4234-4063-4f8d-a3a5-154749f91a52-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:15 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5" returned: 0 in 0.465s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.508s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10259997-c162-4c27-b31b-a3d6f216c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95684722-4712-4042-a2f5-a6bc10d54ca5', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50db4c3c-f6a6-4950-bbe8-9b5e2ad57e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Creating offline snapshot 63c8050f-78e8-4943-90a3-2e76ca8b7e99 of volume d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:48:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Volume volume-95684722-4712-4042-a2f5-a6bc10d54ca5 (95684722-4712-4042-a2f5-a6bc10d54ca5): created successfully Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50db4c3c-f6a6-4950-bbe8-9b5e2ad57e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Flow 'volume_create_manager' (5c6ed2b8-fc82-4122-a394-5f560dfb4118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0269e40c-c26f-4639-88ff-dfa87792364e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:15 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1f38cf60-5060-4dc1-89fc-9b9a0bd81eb5 tempest-VolumesTransfersTest-422349476 None] Created volume successfully. Apr 13 17:48:15 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-ef37e851-2876-4c87-ad09-96543c9810df" returned: 0 in 0.484s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:15 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e Apr 13 17:48:15 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "cinder-quobyte-ef37e851-2876-4c87-ad09-96543c9810df" released by "delete_volume" :: held 1.062s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Created reservations ['5e3c0ce8-dcf1-4b8e-ad07-d887116cb30b', '492860ac-4c12-48d9-9f52-c363a99c4d20', 'e22d1a49-5aea-44f0-bb04-f8201442163f', '6eb48368-9e38-4522-953f-4b4f020a662d'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:15 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:15 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:16 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e" returned: 0 in 0.502s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:16 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 1G Apr 13 17:48:16 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:16 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.467s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:16 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Deleted volume successfully. Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-75b31395-c51b-4e73-8ad9-0ca27cef8f0b tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "cinder-ef37e851-2876-4c87-ad09-96543c9810df-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:16 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 1G" returned: 0 in 0.539s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d810ce5b-b891-42c7-95ab-79f3a710888e -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:16 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d810ce5b-b891-42c7-95ab-79f3a710888e -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 Apr 13 17:48:16 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Acquiring lock "cinder-95684722-4712-4042-a2f5-a6bc10d54ca5-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Lock "cinder-95684722-4712-4042-a2f5-a6bc10d54ca5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Acquiring lock "cinder-quobyte-95684722-4712-4042-a2f5-a6bc10d54ca5" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Lock "cinder-quobyte-95684722-4712-4042-a2f5-a6bc10d54ca5" acquired by "delete_volume" :: waited 0.026s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:16 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[524b8eb0-7729-40dd-9da1-e6bf670f96a2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Flow 'volume_create_manager' (710e9061-abdb-4f5e-a2b2-391d197ffb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036d56d5-e7cc-4a3c-97f1-f498fceb93c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:17 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036d56d5-e7cc-4a3c-97f1-f498fceb93c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1604752743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488a9e50-5f3f-4485-949b-13c6dac51a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74a349002c142dfa4b0fd79fc31bf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:17Z,use_quota=True,user_id='b6776105ec1b4cc2aa188ee9a7e6587c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:17 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 Apr 13 17:48:17 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acdbb15-ed49-4d00-9bed-cdedfb199ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acdbb15-ed49-4d00-9bed-cdedfb199ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee7b140-a66d-4d56-b641-3f0d43accf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee7b140-a66d-4d56-b641-3f0d43accf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488a9e50-5f3f-4485-949b-13c6dac51a81', 'volume_name': 'volume-488a9e50-5f3f-4485-949b-13c6dac51a81', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6858a1ed-b4ad-40b2-9152-4d52ce437cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6858a1ed-b4ad-40b2-9152-4d52ce437cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d155b00-5d5f-445a-955f-d95c37bbc8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:17 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Volume 488a9e50-5f3f-4485-949b-13c6dac51a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488a9e50-5f3f-4485-949b-13c6dac51a81', 'volume_size': 1} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d810ce5b-b891-42c7-95ab-79f3a710888e -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99" returned: 0 in 0.517s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:17 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 is being set with open permissions: ugo+rw Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:17 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 Apr 13 17:48:17 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:17 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5" returned: 0 in 0.493s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:17 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5 Apr 13 17:48:17 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:17 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99" returned: 0 in 0.441s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:17 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.info Apr 13 17:48:17 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:17 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-95684722-4712-4042-a2f5-a6bc10d54ca5" returned: 0 in 0.428s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Lock "cinder-quobyte-95684722-4712-4042-a2f5-a6bc10d54ca5" released by "delete_volume" :: held 0.948s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:17 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Created reservations ['da5d7a8b-9a46-4f00-b31e-84f1c7580a20', '91cac7cb-d06a-41e3-9a7e-652189af1721', '13c54083-d933-4263-9e1d-cfecf09599a7', '81a65491-422b-43dd-9661-8e55a0a14fbf'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:18 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.info" returned: 0 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:18 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.info is being set with open permissions: ugo+rw Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:18 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:18 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:18 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.info Apr 13 17:48:18 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:18 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.info" returned: 0 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1604752743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488a9e50-5f3f-4485-949b-13c6dac51a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74a349002c142dfa4b0fd79fc31bf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:17Z,use_quota=True,user_id='b6776105ec1b4cc2aa188ee9a7e6587c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Creating volume 488a9e50-5f3f-4485-949b-13c6dac51a81 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:18 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:18 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 1073741824 Apr 13 17:48:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1afb5c0f-044d-462e-95a5-ffe66bd69de3 tempest-SnapshotDependencyTests-757100749 None] Create snapshot completed successfully Apr 13 17:48:18 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:18 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.640s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Deleted volume successfully. Apr 13 17:48:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05f8bba6-30d4-4a43-a205-2e1d58b0b9ba tempest-VolumesTransfersTest-1047046181 None] Lock "cinder-95684722-4712-4042-a2f5-a6bc10d54ca5-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:19 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 1073741824" returned: 0 in 0.759s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:19 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 Apr 13 17:48:19 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Flow 'volume_create_manager' (8c6b1d84-8013-4b25-9482-177ebcfd9d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7b4212-9169-4658-ac39-b3ddb3f7f34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7b4212-9169-4658-ac39-b3ddb3f7f34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01e09bc-d80d-4056-8a61-ee3913f0b983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0132b3ffb7d74719b2e24ca7e3e5e5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=63c8050f-78e8-4943-90a3-2e76ca8b7e99,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:19Z,use_quota=True,user_id='b7943a8fec4a4e90b80dde83631a3e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b6ea6c-f70e-4521-9d9a-a565d72be393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b6ea6c-f70e-4521-9d9a-a565d72be393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c5341e-5e25-4f6a-8c2b-883947b4dd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c5341e-5e25-4f6a-8c2b-883947b4dd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b01e09bc-d80d-4056-8a61-ee3913f0b983', 'volume_name': 'volume-b01e09bc-d80d-4056-8a61-ee3913f0b983', 'volume_size': 1, 'snapshot_id': '63c8050f-78e8-4943-90a3-2e76ca8b7e99'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195e3422-5529-46e1-a112-fc5297f65897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195e3422-5529-46e1-a112-fc5297f65897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c499a6-669c-4f39-ab54-9dc4b15fc162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:19 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Volume b01e09bc-d80d-4056-8a61-ee3913f0b983: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b01e09bc-d80d-4056-8a61-ee3913f0b983', 'volume_size': 1, 'snapshot_id': '63c8050f-78e8-4943-90a3-2e76ca8b7e99'} Apr 13 17:48:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:20 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81" returned: 0 in 0.613s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.379s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-quobyte-63c8050f-78e8-4943-90a3-2e76ca8b7e99-b01e09bc-d80d-4056-8a61-ee3913f0b983" by "_create_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d155b00-5d5f-445a-955f-d95c37bbc8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488a9e50-5f3f-4485-949b-13c6dac51a81', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72f7954-65f4-43ea-874c-97630fcfb070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:20 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Volume volume-488a9e50-5f3f-4485-949b-13c6dac51a81 (488a9e50-5f3f-4485-949b-13c6dac51a81): created successfully Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72f7954-65f4-43ea-874c-97630fcfb070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Flow 'volume_create_manager' (710e9061-abdb-4f5e-a2b2-391d197ffb18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-63c8050f-78e8-4943-90a3-2e76ca8b7e99-b01e09bc-d80d-4056-8a61-ee3913f0b983" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Creating volume b01e09bc-d80d-4056-8a61-ee3913f0b983 from snapshot 63c8050f-78e8-4943-90a3-2e76ca8b7e99 {{(pid=82736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-quobyte-b01e09bc-d80d-4056-8a61-ee3913f0b983" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:20 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c05e41f2-5770-4436-83cb-d2a65df98653 tempest-VolumeQuotasAdminTestJSON-1724774488 None] Created volume successfully. Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-b01e09bc-d80d-4056-8a61-ee3913f0b983" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] snapshot: 63c8050f-78e8-4943-90a3-2e76ca8b7e99, volume: b01e09bc-d80d-4056-8a61-ee3913f0b983, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[992cc25c-ee0a-44a8-a370-3364dc56efac]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:20 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 Apr 13 17:48:20 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:20 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:20 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-17f5e524-dbea-4ae2-97eb-f3b6dfc01b2d tempest-VolumeQuotasAdminTestJSON-147089082 None] Transfer volume completed successfully. Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99" returned: 0 in 0.664s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d810ce5b-b891-42c7-95ab-79f3a710888e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[253cf473-4de1-4d2b-9db8-f069d582b1f2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:20 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e Apr 13 17:48:20 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:21 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e" returned: 0 in 0.584s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:21 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 Apr 13 17:48:21 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Acquiring lock "cinder-488a9e50-5f3f-4485-949b-13c6dac51a81-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Lock "cinder-488a9e50-5f3f-4485-949b-13c6dac51a81-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Acquiring lock "cinder-quobyte-488a9e50-5f3f-4485-949b-13c6dac51a81" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Lock "cinder-quobyte-488a9e50-5f3f-4485-949b-13c6dac51a81" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e41be4b-93b6-453d-8991-ba0d6c7b66bc]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:21 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 Apr 13 17:48:21 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:23 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81" returned: 0 in 1.538s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:23 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81 Apr 13 17:48:23 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:23 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983" returned: 0 in 2.276s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:23 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[189fa8e8-3142-48a1-917a-a5e169a611d8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:23 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e Apr 13 17:48:23 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:24 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-488a9e50-5f3f-4485-949b-13c6dac51a81" returned: 0 in 0.710s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Lock "cinder-quobyte-488a9e50-5f3f-4485-949b-13c6dac51a81" released by "delete_volume" :: held 2.275s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Created reservations ['088599c0-f4c4-43cb-b489-ded93f3c4060', '828cee33-6d51-4964-a910-433b07352a27', 'acc38dd3-8ae8-4a16-9022-0e28cbf7447d', 'ba23aee4-1eb7-48c2-844c-c426dd0e7c3c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:24 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:24 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Flow 'volume_create_manager' (47752cab-142c-4709-9b2d-72023f94e265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a1a8c0-6bc4-4730-8ce5-ef57a6b2658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a1a8c0-6bc4-4730-8ce5-ef57a6b2658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-563088211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87928c3-8ad2-4e0b-b472-ceb28ad0498e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e62c6385e0440584c573cb66a7c97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:24Z,use_quota=True,user_id='ba85ca99bb384ad69665586d2d0bf045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098befc3-c78a-4ba6-adb8-b062b33a3ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098befc3-c78a-4ba6-adb8-b062b33a3ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6abebf7-6209-485b-9cf2-25c34301ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6abebf7-6209-485b-9cf2-25c34301ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87928c3-8ad2-4e0b-b472-ceb28ad0498e', 'volume_name': 'volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31878fbe-351e-45c8-a0f1-fbc36adaf0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31878fbe-351e-45c8-a0f1-fbc36adaf0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595cc7ca-9008-4203-8045-e7919e4c0402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:24 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Volume f87928c3-8ad2-4e0b-b472-ceb28ad0498e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e', 'volume_size': 1} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:24 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e" returned: 0 in 0.776s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:48:24 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Converted 1024.00 MB image at 449.52 MB/s Apr 13 17:48:24 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 is being set with open permissions: ugo+rw Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:24 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 Apr 13 17:48:24 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:24 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.505s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:24 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Deleted volume successfully. Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-08eafb83-c896-44c1-907d-528a335fa51b tempest-VolumeQuotasAdminTestJSON-17821905 None] Lock "cinder-488a9e50-5f3f-4485-949b-13c6dac51a81-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:24 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983" returned: 0 in 0.477s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-b01e09bc-d80d-4056-8a61-ee3913f0b983" released by "_copy_volume_from_snapshot" :: held 4.865s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-63c8050f-78e8-4943-90a3-2e76ca8b7e99-b01e09bc-d80d-4056-8a61-ee3913f0b983" released by "_create_volume_from_snapshot" :: held 4.892s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.949s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-563088211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87928c3-8ad2-4e0b-b472-ceb28ad0498e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e62c6385e0440584c573cb66a7c97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:24Z,use_quota=True,user_id='ba85ca99bb384ad69665586d2d0bf045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Creating volume f87928c3-8ad2-4e0b-b472-ceb28ad0498e {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:24 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:24 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e 1073741824 Apr 13 17:48:24 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c499a6-669c-4f39-ab54-9dc4b15fc162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01e09bc-d80d-4056-8a61-ee3913f0b983', 'volume_size': 1, 'snapshot_id': '63c8050f-78e8-4943-90a3-2e76ca8b7e99'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bb1419-c015-492a-b8f8-945adbd3af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:25 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Volume volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 (b01e09bc-d80d-4056-8a61-ee3913f0b983): created successfully Apr 13 17:48:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bb1419-c015-492a-b8f8-945adbd3af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:25 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Flow 'volume_create_manager' (8c6b1d84-8013-4b25-9482-177ebcfd9d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:25 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a81b3f45-3c68-43a1-b38d-1f11960dff3c tempest-SnapshotDependencyTests-757100749 None] Created volume successfully. Apr 13 17:48:25 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e 1073741824" returned: 0 in 0.617s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:25 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e Apr 13 17:48:25 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:26 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e" returned: 0 in 0.464s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595cc7ca-9008-4203-8045-e7919e4c0402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9870f6-e929-4c25-97a4-28c7753dc714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:26 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Volume volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e (f87928c3-8ad2-4e0b-b472-ceb28ad0498e): created successfully Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9870f6-e929-4c25-97a4-28c7753dc714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Flow 'volume_create_manager' (47752cab-142c-4709-9b2d-72023f94e265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-63c8050f-78e8-4943-90a3-2e76ca8b7e99-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f3bcdae2-b234-4272-8904-9d61dc7df898 tempest-VolumesTransfersV357Test-87005074 None] Created volume successfully. Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-63c8050f-78e8-4943-90a3-2e76ca8b7e99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-quobyte-d810ce5b-b891-42c7-95ab-79f3a710888e" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-d810ce5b-b891-42c7-95ab-79f3a710888e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-quobyte-63c8050f-78e8-4943-90a3-2e76ca8b7e99" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-63c8050f-78e8-4943-90a3-2e76ca8b7e99" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Deleting offline snapshot 63c8050f-78e8-4943-90a3-2e76ca8b7e99 of volume d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] snapshot_file for this snap is: volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a7953-a591-477c-b6d5-585372c09999]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:26 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 Apr 13 17:48:26 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:26 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99" returned: 0 in 0.629s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d810ce5b-b891-42c7-95ab-79f3a710888e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[62384d9a-523a-497a-8582-be90e170b4a0]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:26 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e Apr 13 17:48:26 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:27 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-678252dd-3553-4c37-a4a3-e31d5c40b4c1 tempest-VolumesTransfersV357Test-1439893005 None] Transfer volume completed successfully. Apr 13 17:48:27 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e" returned: 0 in 0.736s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:27 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 Apr 13 17:48:27 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Acquiring lock "cinder-f87928c3-8ad2-4e0b-b472-ceb28ad0498e-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Lock "cinder-f87928c3-8ad2-4e0b-b472-ceb28ad0498e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Acquiring lock "cinder-quobyte-f87928c3-8ad2-4e0b-b472-ceb28ad0498e" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Lock "cinder-quobyte-f87928c3-8ad2-4e0b-b472-ceb28ad0498e" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9ac685-44c6-4c98-ae77-a093c3f1bc09]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:28 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99" returned: 0 in 0.688s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:28 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e Apr 13 17:48:28 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:28 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99 Apr 13 17:48:28 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:28 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e.63c8050f-78e8-4943-90a3-2e76ca8b7e99" returned: 0 in 0.619s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-63c8050f-78e8-4943-90a3-2e76ca8b7e99" released by "_delete_snapshot" :: held 2.744s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-d810ce5b-b891-42c7-95ab-79f3a710888e" released by "delete_snapshot" :: held 2.768s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:28 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e" returned: 0 in 0.804s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:29 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e Apr 13 17:48:29 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Created reservations ['6a92d0eb-e99e-43d7-8b39-e2bad7047d5e', '4fab422d-c190-4ab6-a255-3d9823aed149', 'd10409b6-b808-4154-a570-cfdd0f4c3be1', 'e50bc07a-56f9-44f8-bcb2-9e202e334246'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:29 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Delete snapshot completed successfully. Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-cd31f897-579d-4d61-9d6f-3b8740d0cecc tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-63c8050f-78e8-4943-90a3-2e76ca8b7e99-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-d810ce5b-b891-42c7-95ab-79f3a710888e-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-d810ce5b-b891-42c7-95ab-79f3a710888e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-quobyte-d810ce5b-b891-42c7-95ab-79f3a710888e" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-d810ce5b-b891-42c7-95ab-79f3a710888e" acquired by "delete_volume" :: waited 0.018s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aa6d8a-4b0f-40fd-9909-377a4ee3b4fe]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:29 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f87928c3-8ad2-4e0b-b472-ceb28ad0498e" returned: 0 in 0.572s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:29 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e Apr 13 17:48:29 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Lock "cinder-quobyte-f87928c3-8ad2-4e0b-b472-ceb28ad0498e" released by "delete_volume" :: held 1.428s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Created reservations ['3fd07f0e-94ec-4c9d-bcd4-ab3d8f33d501', '7039cf38-2576-4d3b-84c9-866d4e174776', '8828ff40-6401-4533-b780-5d61a17269ed', '4d15e5d3-2d47-49ff-a47f-ad9089b28088'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:29 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:29 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:30 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e" returned: 0 in 0.677s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:30 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e Apr 13 17:48:30 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:30 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.551s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:30 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Deleted volume successfully. Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1d7b6516-b66a-4279-b818-364f97ff2de0 tempest-VolumesTransfersV357Test-725392867 None] Lock "cinder-f87928c3-8ad2-4e0b-b472-ceb28ad0498e-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=146,cinder:INSERT=39,cinder:UPDATE=182,cinder:DELETE=13 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Flow 'volume_create_manager' (7d0e5dbd-6560-4e35-8b5c-ff41b2846207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163792d9-5cba-4960-8c16-6fd75f179943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163792d9-5cba-4960-8c16-6fd75f179943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1612242832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8863a8be-d7d1-4965-9871-cb2a4df077e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e62c6385e0440584c573cb66a7c97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:31Z,use_quota=True,user_id='ba85ca99bb384ad69665586d2d0bf045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394b94a5-dd3f-4ff3-8c6c-5545414c3282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394b94a5-dd3f-4ff3-8c6c-5545414c3282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:30 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23653f5-9df3-4d0f-89f7-9de360676e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23653f5-9df3-4d0f-89f7-9de360676e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8863a8be-d7d1-4965-9871-cb2a4df077e0', 'volume_name': 'volume-8863a8be-d7d1-4965-9871-cb2a4df077e0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0b3d4e-29f1-4d68-94ae-4acdcc9649c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0b3d4e-29f1-4d68-94ae-4acdcc9649c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e57e81d-b991-4bab-b2be-73aa2fa7a02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:30 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Volume 8863a8be-d7d1-4965-9871-cb2a4df077e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8863a8be-d7d1-4965-9871-cb2a4df077e0', 'volume_size': 1} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1612242832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8863a8be-d7d1-4965-9871-cb2a4df077e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e62c6385e0440584c573cb66a7c97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:31Z,use_quota=True,user_id='ba85ca99bb384ad69665586d2d0bf045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Creating volume 8863a8be-d7d1-4965-9871-cb2a4df077e0 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:30 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-d810ce5b-b891-42c7-95ab-79f3a710888e" returned: 0 in 0.695s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-d810ce5b-b891-42c7-95ab-79f3a710888e" released by "delete_volume" :: held 1.418s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:30 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 1073741824 Apr 13 17:48:30 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Created reservations ['51ec3e9b-5ae8-465f-9ec0-e066e4c3318c', '9e305ea2-ecca-4e62-a56f-b10e01909124', 'c75033f8-f755-4bfc-83c9-92d1ddc3d2c5', '19344163-bb95-482b-a57b-b078f8caebe0'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:31 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:31 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:31 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:31 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Deleted volume successfully. Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ef666ec5-0238-484f-8f68-588933ee42df tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-d810ce5b-b891-42c7-95ab-79f3a710888e-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:31 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 1073741824" returned: 0 in 0.715s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:31 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 Apr 13 17:48:31 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-b01e09bc-d80d-4056-8a61-ee3913f0b983-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-b01e09bc-d80d-4056-8a61-ee3913f0b983-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "cinder-quobyte-b01e09bc-d80d-4056-8a61-ee3913f0b983" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-b01e09bc-d80d-4056-8a61-ee3913f0b983" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e5a39-8585-430a-88d1-9330228b124c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:31 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 Apr 13 17:48:31 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (310f0881-fc01-4546-b9c5-9691ff76c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:31 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932bff25-be9b-4146-bac7-7ae73fdac394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932bff25-be9b-4146-bac7-7ae73fdac394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1087306450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31948876-82bc-443c-a15b-7ccd32ed3df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9241f138958043ef9eaf7f8a91b37b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:32Z,use_quota=True,user_id='f14086c2c7e4425b9f556fc14aaefabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690e375c-e318-47dc-b3e2-404bfbfdb359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690e375c-e318-47dc-b3e2-404bfbfdb359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398bb78a-0ffa-4009-ae0f-89e6c454eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398bb78a-0ffa-4009-ae0f-89e6c454eef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31948876-82bc-443c-a15b-7ccd32ed3df8', 'volume_name': 'volume-31948876-82bc-443c-a15b-7ccd32ed3df8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dcb1bb-a19d-4882-8f49-6d8b906dd789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dcb1bb-a19d-4882-8f49-6d8b906dd789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cb3938-d707-4e5d-8fb1-575f2153fdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Volume 31948876-82bc-443c-a15b-7ccd32ed3df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31948876-82bc-443c-a15b-7ccd32ed3df8', 'volume_size': 1} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:32 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0" returned: 0 in 0.526s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1087306450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31948876-82bc-443c-a15b-7ccd32ed3df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9241f138958043ef9eaf7f8a91b37b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:32Z,use_quota=True,user_id='f14086c2c7e4425b9f556fc14aaefabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Creating volume 31948876-82bc-443c-a15b-7ccd32ed3df8 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:32 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:32 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 1073741824 Apr 13 17:48:32 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Flow 'volume_create_manager' (f8833047-188f-4b7b-97cf-76d982afa913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8139670b-a7bf-465e-aa20-68d4ce334583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e57e81d-b991-4bab-b2be-73aa2fa7a02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8863a8be-d7d1-4965-9871-cb2a4df077e0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39c96a7-3c8f-430a-a599-2ec33640f3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8139670b-a7bf-465e-aa20-68d4ce334583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1818881956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e4c247-533f-417a-b331-ff8020b42371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3828be54abb84306908b37549b71adfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:32Z,use_quota=True,user_id='b96786d2c368424da3c876c5dec8ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91f45a0c-5083-4746-9dd3-2bf43e2b7767),volume_type_id=91f45a0c-5083-4746-9dd3-2bf43e2b7767)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186a597d-ecd2-45b5-bd18-a88e71bef485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186a597d-ecd2-45b5-bd18-a88e71bef485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772042fc-6d0f-42e2-b019-27551417e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772042fc-6d0f-42e2-b019-27551417e26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e4c247-533f-417a-b331-ff8020b42371', 'volume_name': 'volume-18e4c247-533f-417a-b331-ff8020b42371', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa37f2cc-40d0-4d21-b8c3-6fefdd8f1429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa37f2cc-40d0-4d21-b8c3-6fefdd8f1429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fdf073-9e1b-487a-9fa4-1a510f8d52b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:32 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Volume 18e4c247-533f-417a-b331-ff8020b42371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e4c247-533f-417a-b331-ff8020b42371', 'volume_size': 1} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:32 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Volume volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 (8863a8be-d7d1-4965-9871-cb2a4df077e0): created successfully Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39c96a7-3c8f-430a-a599-2ec33640f3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Flow 'volume_create_manager' (7d0e5dbd-6560-4e35-8b5c-ff41b2846207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:32 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-73fc0b13-b962-4bac-b2b1-46b666ff050f tempest-VolumesTransfersV357Test-87005074 None] Created volume successfully. Apr 13 17:48:32 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983" returned: 0 in 0.599s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:32 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983 Apr 13 17:48:32 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:32 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 1073741824" returned: 0 in 0.477s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:32 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 Apr 13 17:48:32 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:32 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b01e09bc-d80d-4056-8a61-ee3913f0b983" returned: 0 in 0.414s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-quobyte-b01e09bc-d80d-4056-8a61-ee3913f0b983" released by "delete_volume" :: held 1.056s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Created reservations ['d3e1bfc9-a51d-44a4-a3c4-e4d4c12a1206', '801a2ec4-0745-44fd-9b7b-8a2ebebe9dc1', 'e4e43f04-be9e-450f-9438-0d049309a84c', 'e0fa9333-311b-44ed-8c24-d1274c07d251'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:32 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:32 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:33 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8" returned: 0 in 0.480s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1818881956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e4c247-533f-417a-b331-ff8020b42371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3828be54abb84306908b37549b71adfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:32Z,use_quota=True,user_id='b96786d2c368424da3c876c5dec8ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91f45a0c-5083-4746-9dd3-2bf43e2b7767),volume_type_id=91f45a0c-5083-4746-9dd3-2bf43e2b7767)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Creating volume 18e4c247-533f-417a-b331-ff8020b42371 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:33 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cb3938-d707-4e5d-8fb1-575f2153fdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31948876-82bc-443c-a15b-7ccd32ed3df8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897b13ea-7727-4de0-962b-73611d01328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:33 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 1073741824 Apr 13 17:48:33 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:33 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Volume volume-31948876-82bc-443c-a15b-7ccd32ed3df8 (31948876-82bc-443c-a15b-7ccd32ed3df8): created successfully Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897b13ea-7727-4de0-962b-73611d01328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (310f0881-fc01-4546-b9c5-9691ff76c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:33 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e51ca00e-b177-4951-8d98-98c6fdba0935 tempest-VolumesSnapshotTestJSON-351480142 None] Created volume successfully. Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Acquiring lock "cinder-8863a8be-d7d1-4965-9871-cb2a4df077e0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Lock "cinder-8863a8be-d7d1-4965-9871-cb2a4df077e0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Acquiring lock "cinder-quobyte-8863a8be-d7d1-4965-9871-cb2a4df077e0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Lock "cinder-quobyte-8863a8be-d7d1-4965-9871-cb2a4df077e0" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30e1b92-30c6-4da5-ab71-c8f96a639511]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:33 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.526s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:33 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Deleted volume successfully. Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-237d15b4-1235-4593-a576-bd97b17b362b tempest-SnapshotDependencyTests-757100749 None] Lock "cinder-b01e09bc-d80d-4056-8a61-ee3913f0b983-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:33 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 Apr 13 17:48:33 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:33 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 1073741824" returned: 0 in 0.610s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:33 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 Apr 13 17:48:33 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:33 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0" returned: 0 in 0.536s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:33 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0 Apr 13 17:48:33 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:34 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371" returned: 0 in 0.501s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fdf073-9e1b-487a-9fa4-1a510f8d52b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e4c247-533f-417a-b331-ff8020b42371', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d34d572-c924-437a-9a31-65518379a069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:34 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Volume volume-18e4c247-533f-417a-b331-ff8020b42371 (18e4c247-533f-417a-b331-ff8020b42371): created successfully Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d34d572-c924-437a-9a31-65518379a069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Flow 'volume_create_manager' (f8833047-188f-4b7b-97cf-76d982afa913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:34 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-53114511-c86a-4da1-be48-938e3529dc45 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Created volume successfully. Apr 13 17:48:34 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8863a8be-d7d1-4965-9871-cb2a4df077e0" returned: 0 in 0.505s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Lock "cinder-quobyte-8863a8be-d7d1-4965-9871-cb2a4df077e0" released by "delete_volume" :: held 1.061s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Created reservations ['8ffde62a-e2b4-4ad9-a0b4-e18d27dfc4a9', 'ff3446ac-06db-492b-9ee3-46f70e8b70f7', 'f1e63a5f-1e9f-4dd0-89d6-0c5175ab5943', 'e020b303-43e7-4527-aee3-1aea349f5314'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Creating offline snapshot 802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 of volume 31948876-82bc-443c-a15b-7ccd32ed3df8 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ac6c0-8a41-48f7-8bc9-9e1b6fb6624f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:34 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:34 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:34 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 Apr 13 17:48:34 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:34 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.427s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:34 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Deleted volume successfully. Apr 13 17:48:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d612af4f-b92b-4d7d-bb93-b99a6743c4a9 tempest-VolumesTransfersV357Test-725392867 None] Lock "cinder-8863a8be-d7d1-4965-9871-cb2a4df077e0-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:35 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8" returned: 0 in 0.585s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:35 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 1G Apr 13 17:48:35 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:35 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:35 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:35 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 1G" returned: 0 in 0.640s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31948876-82bc-443c-a15b-7ccd32ed3df8 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:35 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31948876-82bc-443c-a15b-7ccd32ed3df8 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 Apr 13 17:48:35 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:36 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.559s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:36 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-19452909-51c9-484b-a30a-4d75c9e9d4f9 tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Retype volume completed successfully. Apr 13 17:48:36 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31948876-82bc-443c-a15b-7ccd32ed3df8 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4" returned: 0 in 0.605s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:36 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 is being set with open permissions: ugo+rw Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:36 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 Apr 13 17:48:36 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:36 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4" returned: 0 in 0.484s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Acquiring lock "cinder-18e4c247-533f-417a-b331-ff8020b42371-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:36 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.info Apr 13 17:48:36 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "cinder-18e4c247-533f-417a-b331-ff8020b42371-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Acquiring lock "cinder-quobyte-18e4c247-533f-417a-b331-ff8020b42371" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "cinder-quobyte-18e4c247-533f-417a-b331-ff8020b42371" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[88663c75-368d-49fd-b9c3-323d999435f4]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:36 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 Apr 13 17:48:36 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:37 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.info" returned: 0 in 0.465s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:37 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.info is being set with open permissions: ugo+rw Apr 13 17:48:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:37 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.info Apr 13 17:48:37 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:37 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371" returned: 0 in 0.644s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:37 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371 Apr 13 17:48:37 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:37 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.info" returned: 0 in 0.459s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.315s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:37 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:UPDATE=188,cinder:SELECT=156,cinder:INSERT=56,cinder:DELETE=15 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:48:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2ea4b841-7a90-405d-b60b-d45e0bc2a15a tempest-VolumesSnapshotTestJSON-351480142 None] Create snapshot completed successfully Apr 13 17:48:38 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-18e4c247-533f-417a-b331-ff8020b42371" returned: 0 in 0.510s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "cinder-quobyte-18e4c247-533f-417a-b331-ff8020b42371" released by "delete_volume" :: held 1.185s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:38 devstack cinder-volume[82736]: WARNING cinder.quota [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:48:38 devstack cinder-volume[82736]: WARNING cinder.quota [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Created reservations ['b31cef83-748c-4cc7-95b8-3d825bec22c9', '2861f344-885f-4bca-85c9-59ad0d8356a3', '3ec14ad2-e62d-4d1a-8cad-2b4bb3166d5b', 'f33923d9-6660-4a91-9917-efdca096b06d'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:38 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:38 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:38 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.566s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Deleted volume successfully. Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-55d84ac9-3034-4ea3-b4f3-77378b04109b tempest-VolumeRetypeWithoutMigrationTest-1292987601 None] Lock "cinder-18e4c247-533f-417a-b331-ff8020b42371-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-31948876-82bc-443c-a15b-7ccd32ed3df8" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-31948876-82bc-443c-a15b-7ccd32ed3df8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Deleting offline snapshot 802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 of volume 31948876-82bc-443c-a15b-7ccd32ed3df8 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] snapshot_file for this snap is: volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[95199598-4283-485b-994a-42e7f9c85933]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:38 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 Apr 13 17:48:38 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:39 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4" returned: 0 in 0.748s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31948876-82bc-443c-a15b-7ccd32ed3df8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563a272-e4a4-434b-b8b6-9d425b97a22a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:39 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 Apr 13 17:48:39 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Flow 'volume_create_manager' (0d2156d8-4d59-45dc-b142-1e5e9e45a9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c0ce78-28e8-4d5a-b84c-8f6739cac1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c0ce78-28e8-4d5a-b84c-8f6739cac1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1906782070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859c79ab-d687-4039-85e0-a4a4cd61247b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7d0ef2db7943b3be5f7fc1ccd98e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:40Z,use_quota=True,user_id='10d3747c17ee4b368e951fa3ca787d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee94e9b-9230-4a58-b495-fe709f325e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee94e9b-9230-4a58-b495-fe709f325e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129436ee-a34f-413b-8fb4-455766d2bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129436ee-a34f-413b-8fb4-455766d2bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859c79ab-d687-4039-85e0-a4a4cd61247b', 'volume_name': 'volume-859c79ab-d687-4039-85e0-a4a4cd61247b', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9f4652-afa9-45b4-9c81-593cc83aa936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9f4652-afa9-45b4-9c81-593cc83aa936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a709f53-3fc1-418f-a577-4cc3c39787b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:39 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Volume 859c79ab-d687-4039-85e0-a4a4cd61247b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859c79ab-d687-4039-85e0-a4a4cd61247b', 'volume_size': 1} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1906782070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859c79ab-d687-4039-85e0-a4a4cd61247b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7d0ef2db7943b3be5f7fc1ccd98e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:40Z,use_quota=True,user_id='10d3747c17ee4b368e951fa3ca787d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Creating volume 859c79ab-d687-4039-85e0-a4a4cd61247b {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:39 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:39 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b 1073741824 Apr 13 17:48:39 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:40 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8" returned: 0 in 0.622s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:40 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 Apr 13 17:48:40 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:40 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b 1073741824" returned: 0 in 0.619s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:40 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b Apr 13 17:48:40 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:40 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4" returned: 0 in 0.628s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:40 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4 Apr 13 17:48:40 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:41 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b" returned: 0 in 0.581s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a709f53-3fc1-418f-a577-4cc3c39787b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859c79ab-d687-4039-85e0-a4a4cd61247b', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dad8b69-5800-472b-8678-effcfe459736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:41 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Volume volume-859c79ab-d687-4039-85e0-a4a4cd61247b (859c79ab-d687-4039-85e0-a4a4cd61247b): created successfully Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dad8b69-5800-472b-8678-effcfe459736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Flow 'volume_create_manager' (0d2156d8-4d59-45dc-b142-1e5e9e45a9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:41 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3aec5d31-b143-4f85-8901-af9ca08d3457 tempest-VolumesNegativeTest-385383821 None] Created volume successfully. Apr 13 17:48:41 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8.802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4" returned: 0 in 0.502s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4" released by "_delete_snapshot" :: held 2.580s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-31948876-82bc-443c-a15b-7ccd32ed3df8" released by "delete_snapshot" :: held 2.594s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Created reservations ['66574932-4392-47ee-b4f5-0ccc56f16a79', '50f18c83-4ee1-4c18-a4c3-73d5ba384c43', 'fd548efc-ab01-42a2-9bf0-56d6396fa8ef', '11dcbafc-c906-4947-b038-1f1df7e99321'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:41 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Delete snapshot completed successfully. Apr 13 17:48:41 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-10b4e944-5138-482f-8185-4e3e8f839dcb tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-802e23ff-bb1e-4bfa-9d8e-4d7fd0d9a7b4-delete_snapshot" released by "delete_snapshot" :: held 2.729s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (b64e8a47-2b22-4074-b38d-e069ca8fc1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e44bfcd-dafb-4f32-9b1d-ec5a25ba8c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e44bfcd-dafb-4f32-9b1d-ec5a25ba8c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405189227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a58665-cea1-4fba-ac73-02d19174798c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9241f138958043ef9eaf7f8a91b37b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:42Z,use_quota=True,user_id='f14086c2c7e4425b9f556fc14aaefabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3aefcfc-01aa-4030-9bce-71cb761ad1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3aefcfc-01aa-4030-9bce-71cb761ad1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5997699e-8d57-408b-8651-874d11d7e43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5997699e-8d57-408b-8651-874d11d7e43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a58665-cea1-4fba-ac73-02d19174798c', 'volume_name': 'volume-a0a58665-cea1-4fba-ac73-02d19174798c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54de6b72-b4b4-43f9-a228-6650b34a0ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54de6b72-b4b4-43f9-a228-6650b34a0ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebbfc2d-ba26-4ddd-ba97-b6a74410f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:42 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Volume a0a58665-cea1-4fba-ac73-02d19174798c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a58665-cea1-4fba-ac73-02d19174798c', 'volume_size': 1} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405189227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a58665-cea1-4fba-ac73-02d19174798c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9241f138958043ef9eaf7f8a91b37b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:42Z,use_quota=True,user_id='f14086c2c7e4425b9f556fc14aaefabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Creating volume a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:42 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:42 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c 1073741824 Apr 13 17:48:42 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:43 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c 1073741824" returned: 0 in 0.600s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:43 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c Apr 13 17:48:43 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:43 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c" returned: 0 in 0.451s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebbfc2d-ba26-4ddd-ba97-b6a74410f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a58665-cea1-4fba-ac73-02d19174798c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6202c5cb-f55d-43d9-a36e-f8c270617dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:43 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Volume volume-a0a58665-cea1-4fba-ac73-02d19174798c (a0a58665-cea1-4fba-ac73-02d19174798c): created successfully Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6202c5cb-f55d-43d9-a36e-f8c270617dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (b64e8a47-2b22-4074-b38d-e069ca8fc1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:43 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-80ec6819-afb7-4f23-b15e-1052df1c09ba tempest-VolumesSnapshotTestJSON-351480142 None] Created volume successfully. Apr 13 17:48:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Creating offline snapshot 6c057f05-cd10-4de6-b9b0-b5562c4f4950 of volume a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:48:44 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cf7004-5c38-498d-aa8c-651bd31b1392]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:44 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c Apr 13 17:48:44 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:45 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c" returned: 0 in 0.579s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:45 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 1G Apr 13 17:48:45 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:45 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 1G" returned: 0 in 0.593s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a58665-cea1-4fba-ac73-02d19174798c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:45 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a58665-cea1-4fba-ac73-02d19174798c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 Apr 13 17:48:45 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:46 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a58665-cea1-4fba-ac73-02d19174798c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950" returned: 0 in 0.503s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:46 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 is being set with open permissions: ugo+rw Apr 13 17:48:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:46 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 Apr 13 17:48:46 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:46 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:46 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.info Apr 13 17:48:46 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:47 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.info" returned: 0 in 0.501s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:47 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.info is being set with open permissions: ugo+rw Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:47 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.info Apr 13 17:48:47 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Flow 'volume_create_manager' (32cde513-f3e7-42a6-92f4-ed4120a1ca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af0064f-a083-4792-86e8-f50d168ae42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af0064f-a083-4792-86e8-f50d168ae42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1736398294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a620f02-3546-4cc4-be59-c5a7a544050d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ffa23aadfb47d6b8f1ea568e1fbc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:48Z,use_quota=True,user_id='0b9116f2b8c540db84b0f7a7dad13ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93d6f14-87ae-4ad7-8945-87e09028c5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93d6f14-87ae-4ad7-8945-87e09028c5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b87964-ebda-4429-b2b4-f7641b84b85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b87964-ebda-4429-b2b4-f7641b84b85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a620f02-3546-4cc4-be59-c5a7a544050d', 'volume_name': 'volume-1a620f02-3546-4cc4-be59-c5a7a544050d', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d1f4b1-acea-48bf-a1b6-b61a1799b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d1f4b1-acea-48bf-a1b6-b61a1799b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5de4487-0b13-4cb2-bc19-898a9a4373d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:47 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Volume 1a620f02-3546-4cc4-be59-c5a7a544050d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a620f02-3546-4cc4-be59-c5a7a544050d', 'volume_size': 1} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:47 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.info" returned: 0 in 0.485s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.216s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1736398294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a620f02-3546-4cc4-be59-c5a7a544050d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ffa23aadfb47d6b8f1ea568e1fbc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:48Z,use_quota=True,user_id='0b9116f2b8c540db84b0f7a7dad13ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Creating volume 1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:47 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:48:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:47 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d 1073741824 Apr 13 17:48:47 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:47 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-dcbcc67f-ffe7-4b07-b237-78114df9e100 tempest-VolumesSnapshotTestJSON-351480142 None] Create snapshot completed successfully Apr 13 17:48:48 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d 1073741824" returned: 0 in 0.594s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:48 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d Apr 13 17:48:48 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:48 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d" returned: 0 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5de4487-0b13-4cb2-bc19-898a9a4373d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a620f02-3546-4cc4-be59-c5a7a544050d', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fc4594-ec73-45c7-bee1-737588c97b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:48 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Volume volume-1a620f02-3546-4cc4-be59-c5a7a544050d (1a620f02-3546-4cc4-be59-c5a7a544050d): created successfully Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fc4594-ec73-45c7-bee1-737588c97b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Flow 'volume_create_manager' (32cde513-f3e7-42a6-92f4-ed4120a1ca11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:48 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-83f05d42-6da5-4619-a0ca-81163fc81c44 tempest-VolumesCloneTest-1735017614 None] Created volume successfully. Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (cd180032-34c5-4cda-b84b-df287aad294c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806fa0a6-73a1-4828-9644-eebaad030952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806fa0a6-73a1-4828-9644-eebaad030952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-4521455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6929aa89-4521-4d76-80e7-7886cf934942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9241f138958043ef9eaf7f8a91b37b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6c057f05-cd10-4de6-b9b0-b5562c4f4950,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:49Z,use_quota=True,user_id='f14086c2c7e4425b9f556fc14aaefabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534d3f50-00c7-4607-bb60-60f9a6916c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534d3f50-00c7-4607-bb60-60f9a6916c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361ee033-416b-4d5b-a334-c3f00c70f072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361ee033-416b-4d5b-a334-c3f00c70f072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6929aa89-4521-4d76-80e7-7886cf934942', 'volume_name': 'volume-6929aa89-4521-4d76-80e7-7886cf934942', 'volume_size': 2, 'snapshot_id': '6c057f05-cd10-4de6-b9b0-b5562c4f4950'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca37d66-1373-4921-b8d7-bdcfff0ab928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca37d66-1373-4921-b8d7-bdcfff0ab928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2318fea-c837-413d-91b5-b55d55623537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:49 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Volume 6929aa89-4521-4d76-80e7-7886cf934942: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6929aa89-4521-4d76-80e7-7886cf934942', 'volume_size': 2, 'snapshot_id': '6c057f05-cd10-4de6-b9b0-b5562c4f4950'} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-6c057f05-cd10-4de6-b9b0-b5562c4f4950-6929aa89-4521-4d76-80e7-7886cf934942" by "_create_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-6c057f05-cd10-4de6-b9b0-b5562c4f4950-6929aa89-4521-4d76-80e7-7886cf934942" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Creating volume 6929aa89-4521-4d76-80e7-7886cf934942 from snapshot 6c057f05-cd10-4de6-b9b0-b5562c4f4950 {{(pid=82736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-6929aa89-4521-4d76-80e7-7886cf934942" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-6929aa89-4521-4d76-80e7-7886cf934942" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] snapshot: 6c057f05-cd10-4de6-b9b0-b5562c4f4950, volume: 6929aa89-4521-4d76-80e7-7886cf934942, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb462d-912e-43cf-8f97-5ab7b2f40dc6]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:49 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 Apr 13 17:48:49 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:49 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950" returned: 0 in 0.514s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a58665-cea1-4fba-ac73-02d19174798c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[72921b9a-93d4-42d1-9692-88434ea5a169]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:49 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c Apr 13 17:48:49 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Flow 'volume_create_manager' (647c5bae-a9e0-4593-bc47-3cfdfcf0e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084e79ca-fae8-4e83-95c6-6f3f924265c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084e79ca-fae8-4e83-95c6-6f3f924265c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1174169590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d198772-f61a-4707-a716-65719d5e742f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ffa23aadfb47d6b8f1ea568e1fbc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:48:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1a620f02-3546-4cc4-be59-c5a7a544050d,status='creating',terminated_at=None,updated_at=2026-04-13T15:48:50Z,use_quota=True,user_id='0b9116f2b8c540db84b0f7a7dad13ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0359f161-5628-4c6b-b33c-5de1aa4e971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0359f161-5628-4c6b-b33c-5de1aa4e971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b7867f-dda7-44e9-ba90-996cac169bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b7867f-dda7-44e9-ba90-996cac169bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8d198772-f61a-4707-a716-65719d5e742f', 'volume_name': 'volume-8d198772-f61a-4707-a716-65719d5e742f', 'volume_size': 2, 'source_volid': '1a620f02-3546-4cc4-be59-c5a7a544050d', 'source_volstatus': 'available'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce08a219-9ee1-4188-8a25-932f7a7f725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce08a219-9ee1-4188-8a25-932f7a7f725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bffc42a-4ca0-4dc8-80e4-f2a9f0a99e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:50 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Volume 8d198772-f61a-4707-a716-65719d5e742f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8d198772-f61a-4707-a716-65719d5e742f', 'volume_size': 2, 'source_volid': '1a620f02-3546-4cc4-be59-c5a7a544050d', 'source_volstatus': 'available'} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:50 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:48:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:50 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 Apr 13 17:48:50 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:52 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942" returned: 0 in 1.958s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:52 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e59db-ae23-411a-9c78-ccdbe45bfb03]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:52 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c Apr 13 17:48:52 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:52 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c" returned: 0 in 0.622s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:52 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:48:52 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Converted 1024.00 MB image at 522.36 MB/s Apr 13 17:48:52 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 is being set with open permissions: ugo+rw Apr 13 17:48:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:52 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 Apr 13 17:48:52 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:53 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942" returned: 0 in 0.399s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-6929aa89-4521-4d76-80e7-7886cf934942" released by "_copy_volume_from_snapshot" :: held 4.089s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-6c057f05-cd10-4de6-b9b0-b5562c4f4950-6929aa89-4521-4d76-80e7-7886cf934942" released by "_create_volume_from_snapshot" :: held 4.108s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.117s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.088s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:53 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Cloning volume 1a620f02-3546-4cc4-be59-c5a7a544050d to volume 8d198772-f61a-4707-a716-65719d5e742f Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2318fea-c837-413d-91b5-b55d55623537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6929aa89-4521-4d76-80e7-7886cf934942', 'volume_size': 2, 'snapshot_id': '6c057f05-cd10-4de6-b9b0-b5562c4f4950'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438c14a7-32f5-4099-a926-31fac1317292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:48:53 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Volume volume-6929aa89-4521-4d76-80e7-7886cf934942 (6929aa89-4521-4d76-80e7-7886cf934942): created successfully Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438c14a7-32f5-4099-a926-31fac1317292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (cd180032-34c5-4cda-b84b-df287aad294c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Creating offline snapshot b93b9456-8b09-4358-b378-0834c3ca7320 of volume 1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:48:53 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ce573630-b288-4bfb-bdc4-09359c8b4240 tempest-VolumesSnapshotTestJSON-351480142 None] Created volume successfully. Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c444ca7-bd8c-4077-bcc8-cb64dd1a793e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:53 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d Apr 13 17:48:53 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-6929aa89-4521-4d76-80e7-7886cf934942-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-6929aa89-4521-4d76-80e7-7886cf934942-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-6929aa89-4521-4d76-80e7-7886cf934942" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-6929aa89-4521-4d76-80e7-7886cf934942" acquired by "delete_volume" :: waited 0.023s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b3839b-af4b-4399-a49d-ecfc6c80738c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:53 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 Apr 13 17:48:53 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:53 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d" returned: 0 in 0.521s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:53 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 1G Apr 13 17:48:53 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:54 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942" returned: 0 in 0.627s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:54 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942 Apr 13 17:48:54 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:54 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 1G" returned: 0 in 0.764s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a620f02-3546-4cc4-be59-c5a7a544050d -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:54 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a620f02-3546-4cc4-be59-c5a7a544050d -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 Apr 13 17:48:54 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:54 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-6929aa89-4521-4d76-80e7-7886cf934942" returned: 0 in 0.605s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-6929aa89-4521-4d76-80e7-7886cf934942" released by "delete_volume" :: held 1.268s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Created reservations ['899a213e-3c3d-4064-b5c9-85a86227271e', '4169a42e-21eb-4a90-a21d-a847920f1e5e', '76eee394-a873-439d-8f11-754f6362cea0', 'f7e28078-c476-4dac-824e-301d83f8d34f'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:54 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:48:54 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:55 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a620f02-3546-4cc4-be59-c5a7a544050d -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320" returned: 0 in 0.526s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:55 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 is being set with open permissions: ugo+rw Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:55 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 Apr 13 17:48:55 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:55 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.479s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:48:55 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Deleted volume successfully. Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-48f52054-3d07-43ad-bd6a-0ea3c87a9a3c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-6929aa89-4521-4d76-80e7-7886cf934942-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:55 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320" returned: 0 in 0.460s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:55 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.info Apr 13 17:48:55 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-6c057f05-cd10-4de6-b9b0-b5562c4f4950-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-6c057f05-cd10-4de6-b9b0-b5562c4f4950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-a0a58665-cea1-4fba-ac73-02d19174798c" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-a0a58665-cea1-4fba-ac73-02d19174798c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-6c057f05-cd10-4de6-b9b0-b5562c4f4950" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-6c057f05-cd10-4de6-b9b0-b5562c4f4950" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Deleting offline snapshot 6c057f05-cd10-4de6-b9b0-b5562c4f4950 of volume a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] snapshot_file for this snap is: volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5692ff48-2f3b-497e-8038-56f72446faab]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:55 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 Apr 13 17:48:55 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:56 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.info" returned: 0 in 0.525s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:56 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.info is being set with open permissions: ugo+rw Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:56 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.info Apr 13 17:48:56 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:56 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950" returned: 0 in 0.639s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a58665-cea1-4fba-ac73-02d19174798c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6b35a-dcc3-436e-b15e-0aee48b7f91d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:56 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c Apr 13 17:48:56 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:56 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.info" returned: 0 in 0.551s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Acquiring lock "cinder-quobyte-8d198772-f61a-4707-a716-65719d5e742f" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Lock "cinder-quobyte-8d198772-f61a-4707-a716-65719d5e742f" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] snapshot: b93b9456-8b09-4358-b378-0834c3ca7320, volume: 8d198772-f61a-4707-a716-65719d5e742f, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8902772b-e2bf-4c29-a5b6-0110eb61b563]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:56 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 Apr 13 17:48:56 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:57 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:57 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 Apr 13 17:48:57 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:57 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320" returned: 0 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a620f02-3546-4cc4-be59-c5a7a544050d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16bfb3d-b62a-47da-8f2f-a5b1a04a3b4f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:57 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d Apr 13 17:48:57 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:57 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950" returned: 0 in 0.584s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:57 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950 Apr 13 17:48:57 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:57 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d" returned: 0 in 0.577s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:48:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:57 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f Apr 13 17:48:57 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:48:58 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 13 17:48:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c.6c057f05-cd10-4de6-b9b0-b5562c4f4950" returned: 0 in 0.449s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:48:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-6c057f05-cd10-4de6-b9b0-b5562c4f4950" released by "_delete_snapshot" :: held 2.249s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-a0a58665-cea1-4fba-ac73-02d19174798c" released by "delete_snapshot" :: held 2.265s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:58 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Created reservations ['bcbce33d-1c2e-4078-a731-f369475ccb9c', '6a675921-9083-4ec6-a8de-bd050d12c1f2', '0b97c4da-176a-4362-8358-d56643d937b2', '3d5ee91f-8f45-46c1-94b8-cd60a0338472'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:48:58 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Delete snapshot completed successfully. Apr 13 17:48:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-58c5c9db-7abf-447d-b625-de567717a179 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-6c057f05-cd10-4de6-b9b0-b5562c4f4950-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:48:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-a0a58665-cea1-4fba-ac73-02d19174798c-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-a0a58665-cea1-4fba-ac73-02d19174798c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-a0a58665-cea1-4fba-ac73-02d19174798c" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:48:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-a0a58665-cea1-4fba-ac73-02d19174798c" acquired by "delete_volume" :: waited 0.026s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:48:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35b77b9-6062-4919-bda4-7b8ac1eb5438]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:48:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:48:59 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c Apr 13 17:48:59 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:00 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f" returned: 0 in 2.163s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c0abe-551b-4f30-ba9f-72a7a72207d8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:00 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d Apr 13 17:49:00 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:00 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c" returned: 0 in 0.812s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:00 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c Apr 13 17:49:00 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:00 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d" returned: 0 in 0.622s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:49:00 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Converted 1024.00 MB image at 473.00 MB/s Apr 13 17:49:00 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f is being set with open permissions: ugo+rw Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:00 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f Apr 13 17:49:00 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:00 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a0a58665-cea1-4fba-ac73-02d19174798c" returned: 0 in 0.425s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-a0a58665-cea1-4fba-ac73-02d19174798c" released by "delete_volume" :: held 1.310s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Created reservations ['df91bff6-5652-491d-8693-9f677828f195', '07178995-7dfb-47b0-95f2-3f482fdde187', '573386da-c43e-429c-82bf-4b57870ced21', '4253ac20-ef04-43df-9766-02882c9704ea'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:00 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:00 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:01 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f" returned: 0 in 0.455s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Lock "cinder-quobyte-8d198772-f61a-4707-a716-65719d5e742f" released by "_copy_volume_from_snapshot" :: held 4.391s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Acquiring lock "cinder-quobyte-b93b9456-8b09-4358-b378-0834c3ca7320" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Lock "cinder-quobyte-b93b9456-8b09-4358-b378-0834c3ca7320" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Deleting offline snapshot b93b9456-8b09-4358-b378-0834c3ca7320 of volume 1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] snapshot_file for this snap is: volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c143b5-ddc3-4bb1-b19d-9f5a2452a55d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:01 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 Apr 13 17:49:01 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:01 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.455s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Deleted volume successfully. Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f79fe4db-714f-42ff-bb71-98b89399c72b tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-a0a58665-cea1-4fba-ac73-02d19174798c-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:01 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320" returned: 0 in 0.495s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a620f02-3546-4cc4-be59-c5a7a544050d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfb8c37-46ea-46c9-9a96-7b4acded8b02]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:01 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d Apr 13 17:49:01 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (0ebc39ad-a0f0-413b-837d-54b8248454f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50bbf47-4f61-421c-8450-381cfba67ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50bbf47-4f61-421c-8450-381cfba67ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-127288179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b18ad3c-aeff-4667-be37-f2635ac53b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9241f138958043ef9eaf7f8a91b37b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:02Z,use_quota=True,user_id='f14086c2c7e4425b9f556fc14aaefabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945f0b31-22cf-4078-9825-7f8da01ab34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945f0b31-22cf-4078-9825-7f8da01ab34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a99659-b618-4b32-94d4-0741a6b05b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a99659-b618-4b32-94d4-0741a6b05b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b18ad3c-aeff-4667-be37-f2635ac53b2c', 'volume_name': 'volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f53e2d-00ef-4a2e-ab93-0e0deb2d7bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f53e2d-00ef-4a2e-ab93-0e0deb2d7bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726917ba-3063-4df2-af14-0f564e286a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:01 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Volume 7b18ad3c-aeff-4667-be37-f2635ac53b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c', 'volume_size': 1} Apr 13 17:49:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:02 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d" returned: 0 in 0.503s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:02 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 Apr 13 17:49:02 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:02 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320" returned: 0 in 0.480s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:02 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320 Apr 13 17:49:02 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:03 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d.b93b9456-8b09-4358-b378-0834c3ca7320" returned: 0 in 0.410s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Lock "cinder-quobyte-b93b9456-8b09-4358-b378-0834c3ca7320" released by "_delete_snapshot" :: held 1.938s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.840s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-127288179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b18ad3c-aeff-4667-be37-f2635ac53b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9241f138958043ef9eaf7f8a91b37b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:02Z,use_quota=True,user_id='f14086c2c7e4425b9f556fc14aaefabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Creating volume 7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:03 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:03 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c 1073741824 Apr 13 17:49:03 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bffc42a-4ca0-4dc8-80e4-f2a9f0a99e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d198772-f61a-4707-a716-65719d5e742f', 'volume_size': 2, 'source_volid': '1a620f02-3546-4cc4-be59-c5a7a544050d', 'source_volstatus': 'available'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4133224-22ee-4b28-9982-f41ab6a6efa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:03 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Volume volume-8d198772-f61a-4707-a716-65719d5e742f (8d198772-f61a-4707-a716-65719d5e742f): created successfully Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4133224-22ee-4b28-9982-f41ab6a6efa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Flow 'volume_create_manager' (647c5bae-a9e0-4593-bc47-3cfdfcf0e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:03 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a60e2ad1-9ac7-433f-9431-f9788dc7963a tempest-VolumesCloneTest-1735017614 None] Created volume successfully. Apr 13 17:49:03 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c 1073741824" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:03 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c Apr 13 17:49:03 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:04 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c" returned: 0 in 0.439s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726917ba-3063-4df2-af14-0f564e286a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ec04c4-bdec-4c54-bb59-05efb55ceb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:04 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Volume volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c (7b18ad3c-aeff-4667-be37-f2635ac53b2c): created successfully Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ec04c4-bdec-4c54-bb59-05efb55ceb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (0ebc39ad-a0f0-413b-837d-54b8248454f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:04 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1728bc86-bd75-4f7e-a2a2-8fff67d7eb5d tempest-VolumesSnapshotTestJSON-351480142 None] Created volume successfully. Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Acquiring lock "cinder-8d198772-f61a-4707-a716-65719d5e742f-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Lock "cinder-8d198772-f61a-4707-a716-65719d5e742f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Acquiring lock "cinder-quobyte-8d198772-f61a-4707-a716-65719d5e742f" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Lock "cinder-quobyte-8d198772-f61a-4707-a716-65719d5e742f" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be7da2-519d-46b0-b277-6828b6670ae2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:04 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f Apr 13 17:49:04 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:04 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f" returned: 0 in 0.502s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:04 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f Apr 13 17:49:04 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Creating offline snapshot 1b27eb60-4809-4f12-a6f0-6304b95f7387 of volume 7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b9be4-e2c1-4ac9-b372-4ce6a38bc635]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:05 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c Apr 13 17:49:05 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:05 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-8d198772-f61a-4707-a716-65719d5e742f" returned: 0 in 0.450s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Lock "cinder-quobyte-8d198772-f61a-4707-a716-65719d5e742f" released by "delete_volume" :: held 0.977s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Created reservations ['8f320a35-fcb5-4636-8256-9bf54ba72f2d', '92e3b8ab-7abf-4ec6-8cf4-25449a84a5ed', '19e0ce78-c18b-4ea0-92c9-f720a26549c9', '9cc77de5-a241-4286-a368-5413b078a637'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:05 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:05 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Acquiring lock "cinder-1a620f02-3546-4cc4-be59-c5a7a544050d-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Lock "cinder-1a620f02-3546-4cc4-be59-c5a7a544050d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Acquiring lock "cinder-quobyte-1a620f02-3546-4cc4-be59-c5a7a544050d" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Lock "cinder-quobyte-1a620f02-3546-4cc4-be59-c5a7a544050d" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8a7d16-92bf-4fab-a1f3-8beca50b1423]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:05 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d Apr 13 17:49:05 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:05 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c" returned: 0 in 0.632s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:05 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 1G Apr 13 17:49:05 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:05 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.513s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:05 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:05 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Deleted volume successfully. Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4ceb9abc-a3b5-4529-81ec-acebb64a846b tempest-VolumesCloneTest-1735017614 None] Lock "cinder-8d198772-f61a-4707-a716-65719d5e742f-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:06 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d" returned: 0 in 0.576s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:06 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d Apr 13 17:49:06 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:06 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 1G" returned: 0 in 0.628s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:06 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 Apr 13 17:49:06 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:06 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1a620f02-3546-4cc4-be59-c5a7a544050d" returned: 0 in 0.482s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Lock "cinder-quobyte-1a620f02-3546-4cc4-be59-c5a7a544050d" released by "delete_volume" :: held 1.090s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Created reservations ['91bf8cd5-9480-47ad-97a2-b5e1b98cc995', 'cac85b5e-2517-48cd-98ad-b8c15da7c0e2', '7c56adbf-43e4-4233-9ecd-42cc0968a717', 'bbe12e96-7d45-48ae-a81e-3c44385369c5'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:06 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:06 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:06 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387" returned: 0 in 0.486s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:06 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 is being set with open permissions: ugo+rw Apr 13 17:49:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:06 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 Apr 13 17:49:06 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:07 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.487s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Deleted volume successfully. Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9df62584-d8ec-4291-a165-ca73920d19ae tempest-VolumesCloneTest-1735017614 None] Lock "cinder-1a620f02-3546-4cc4-be59-c5a7a544050d-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:07 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387" returned: 0 in 0.503s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:07 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.info Apr 13 17:49:07 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Acquiring lock "cinder-859c79ab-d687-4039-85e0-a4a4cd61247b-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Lock "cinder-859c79ab-d687-4039-85e0-a4a4cd61247b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Acquiring lock "cinder-quobyte-859c79ab-d687-4039-85e0-a4a4cd61247b" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Lock "cinder-quobyte-859c79ab-d687-4039-85e0-a4a4cd61247b" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b443fc-a399-47ef-8461-5bc5624d7897]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:07 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.info" returned: 0 in 0.522s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:07 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.info is being set with open permissions: ugo+rw Apr 13 17:49:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:07 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b Apr 13 17:49:07 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:08 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.info Apr 13 17:49:08 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:08 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.info" returned: 0 in 0.458s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.293s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:08 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-7798811a-437c-4b09-9116-1104d79f1dcc tempest-VolumesSnapshotTestJSON-351480142 None] Create snapshot completed successfully Apr 13 17:49:08 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b" returned: 0 in 0.570s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:08 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b Apr 13 17:49:08 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:08 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-859c79ab-d687-4039-85e0-a4a4cd61247b" returned: 0 in 0.442s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:08 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Lock "cinder-quobyte-859c79ab-d687-4039-85e0-a4a4cd61247b" released by "delete_volume" :: held 1.050s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:08 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Created reservations ['a7978054-ca7b-47f2-8c3d-40d1fe6af462', 'b2ae8376-f403-4ee5-92b4-557b7feb5402', '979cc250-b024-4e83-bc87-2171b3bb038d', '85a754c3-d181-4787-80c1-be831aaf7934'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:09 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:09 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:09 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.500s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:09 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Deleted volume successfully. Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d543b1a4-a416-4d94-8de1-3d97fb81336c tempest-VolumesNegativeTest-385383821 None] Lock "cinder-859c79ab-d687-4039-85e0-a4a4cd61247b-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (fca34f96-b08a-4770-b21c-de3c72fea29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53469309-aeee-4ba3-afa5-c2a2848d4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53469309-aeee-4ba3-afa5-c2a2848d4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-895071450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ceb92ff-ec17-46d3-a67b-4e45da7f81f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9241f138958043ef9eaf7f8a91b37b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b27eb60-4809-4f12-a6f0-6304b95f7387,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:10Z,use_quota=True,user_id='f14086c2c7e4425b9f556fc14aaefabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea15efac-d53a-47df-b04d-4ca4edca8fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea15efac-d53a-47df-b04d-4ca4edca8fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ba149c-c006-4d21-b0f1-dfb1480e292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ba149c-c006-4d21-b0f1-dfb1480e292d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ceb92ff-ec17-46d3-a67b-4e45da7f81f0', 'volume_name': 'volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0', 'volume_size': 1, 'snapshot_id': '1b27eb60-4809-4f12-a6f0-6304b95f7387'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f70c14-265a-4120-873b-0bdcc1ce83de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f70c14-265a-4120-873b-0bdcc1ce83de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bea8e9-8416-4126-82ac-f9045c852715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Volume 5ceb92ff-ec17-46d3-a67b-4e45da7f81f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0', 'volume_size': 1, 'snapshot_id': '1b27eb60-4809-4f12-a6f0-6304b95f7387'} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-1b27eb60-4809-4f12-a6f0-6304b95f7387-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" by "_create_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Flow 'volume_create_manager' (9f3cd307-fbd2-445b-9cd1-baf3ab082da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c01ca8-c030-41d0-b2e2-065bafebb712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c01ca8-c030-41d0-b2e2-065bafebb712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2096703019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd2f42a-9958-49f4-ad21-693e122a0ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08778fee42024be4a8822911d4cade46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:10Z,use_quota=True,user_id='8ccfa6d0960a4219af94b57017e7567d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c27ac5-eddd-4962-acac-7f805eba369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c27ac5-eddd-4962-acac-7f805eba369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca784c1-1e89-4e25-8a36-77c271f72628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca784c1-1e89-4e25-8a36-77c271f72628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd2f42a-9958-49f4-ad21-693e122a0ac7', 'volume_name': 'volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7', 'volume_size': 2}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efe1006-14a8-4102-91d6-d9c894ca0386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efe1006-14a8-4102-91d6-d9c894ca0386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed91428-966a-4f42-9c14-d36e4135c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:09 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Volume 3dd2f42a-9958-49f4-ad21-693e122a0ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7', 'volume_size': 2} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-1b27eb60-4809-4f12-a6f0-6304b95f7387-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Creating volume 5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 from snapshot 1b27eb60-4809-4f12-a6f0-6304b95f7387 {{(pid=82736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] snapshot: 1b27eb60-4809-4f12-a6f0-6304b95f7387, volume: 5ceb92ff-ec17-46d3-a67b-4e45da7f81f0, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:49:09 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:09 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd56f3b-0cbd-497c-ad8d-1a5faf1aedcb]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:09 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 Apr 13 17:49:09 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:10 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.442s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:10 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387" returned: 0 in 0.482s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f046cdd-f5eb-4a74-8f68-33842e3edae9]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:10 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c Apr 13 17:49:10 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:10 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c" returned: 0 in 0.480s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:49:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:10 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 Apr 13 17:49:10 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:11 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (d3591d1e-7128-4832-ab76-e424a892af67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b961f1f-f732-42dd-bf4f-ee47498f6e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b961f1f-f732-42dd-bf4f-ee47498f6e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-948111015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:12Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb4e78-50d4-4c46-be18-8356318d7536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb4e78-50d4-4c46-be18-8356318d7536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786c2c8f-1c13-4313-8ba3-ed0b5be82c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786c2c8f-1c13-4313-8ba3-ed0b5be82c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0', 'volume_name': 'volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c953677c-f07c-445b-a97e-4241a3b79581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c953677c-f07c-445b-a97e-4241a3b79581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc41b5b-c91b-4f91-b9b9-29e133c2b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:12 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume 7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0', 'volume_size': 1} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:12 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" returned: 0 in 1.951s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5faf573-0050-43c8-a6bf-f4a31baa96c6]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:12 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c Apr 13 17:49:12 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:13 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c" returned: 0 in 0.571s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:49:13 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Converted 1024.00 MB image at 524.49 MB/s Apr 13 17:49:13 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 is being set with open permissions: ugo+rw Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:13 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 Apr 13 17:49:13 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:13 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" returned: 0 in 0.389s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" released by "_copy_volume_from_snapshot" :: held 3.936s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-1b27eb60-4809-4f12-a6f0-6304b95f7387-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" released by "_create_volume_from_snapshot" :: held 3.968s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.034s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.974s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2096703019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd2f42a-9958-49f4-ad21-693e122a0ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08778fee42024be4a8822911d4cade46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:10Z,use_quota=True,user_id='8ccfa6d0960a4219af94b57017e7567d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Creating volume 3dd2f42a-9958-49f4-ad21-693e122a0ac7 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:13 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 2147483648 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:13 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 2147483648 Apr 13 17:49:13 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bea8e9-8416-4126-82ac-f9045c852715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0', 'volume_size': 1, 'snapshot_id': '1b27eb60-4809-4f12-a6f0-6304b95f7387'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3063cadf-af27-4a85-bf63-12769d95305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:13 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Volume volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 (5ceb92ff-ec17-46d3-a67b-4e45da7f81f0): created successfully Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3063cadf-af27-4a85-bf63-12769d95305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Flow 'volume_create_manager' (fca34f96-b08a-4770-b21c-de3c72fea29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:13 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-80980b8e-eff9-4901-991d-41788146c50e tempest-VolumesSnapshotTestJSON-351480142 None] Created volume successfully. Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b5873e-f73e-489c-9569-b0546b82ea59]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:14 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 Apr 13 17:49:14 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:14 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 2147483648" returned: 0 in 0.519s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:14 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 Apr 13 17:49:14 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:14 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" returned: 0 in 0.512s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:14 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0 Apr 13 17:49:14 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:14 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7" returned: 0 in 0.399s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.563s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-948111015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:12Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Creating volume 7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:14 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed91428-966a-4f42-9c14-d36e4135c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7', 'volume_size': 2}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:14 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 1073741824 Apr 13 17:49:14 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6608b662-318a-41e7-8b99-6c03976211ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:14 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Volume volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 (3dd2f42a-9958-49f4-ad21-693e122a0ac7): created successfully Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6608b662-318a-41e7-8b99-6c03976211ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Flow 'volume_create_manager' (9f3cd307-fbd2-445b-9cd1-baf3ab082da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:14 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-18080942-c760-409b-89a9-979787c48e43 tempest-VolumesCloneNegativeTest-1779256708 None] Created volume successfully. Apr 13 17:49:15 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" returned: 0 in 0.461s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0" released by "delete_volume" :: held 0.993s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Created reservations ['baeed718-64da-4450-9eea-4be4e1b70e8f', '2cbdbb28-d9c6-498d-accb-4da18340fc96', '2ddc19d1-1db2-4268-9ef9-6ea0091df17c', 'cfd8db3c-3962-49e9-82cb-dd4aeafa35e0'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Acquiring lock "cinder-3dd2f42a-9958-49f4-ad21-693e122a0ac7-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Lock "cinder-3dd2f42a-9958-49f4-ad21-693e122a0ac7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:15 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:15 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Acquiring lock "cinder-quobyte-3dd2f42a-9958-49f4-ad21-693e122a0ac7" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Lock "cinder-quobyte-3dd2f42a-9958-49f4-ad21-693e122a0ac7" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:15 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 1073741824" returned: 0 in 0.546s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d57230-2014-4571-9587-c8e73ad9e6ef]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:15 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 Apr 13 17:49:15 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:15 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 Apr 13 17:49:15 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:15 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.452s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:15 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Deleted volume successfully. Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c80d8799-2c5b-455f-bc52-a039686fc8ed tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-5ceb92ff-ec17-46d3-a67b-4e45da7f81f0-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:15 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0" returned: 0 in 0.441s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc41b5b-c91b-4f91-b9b9-29e133c2b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb25f003-ad65-4701-a2d6-686290205165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 (7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0): created successfully Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb25f003-ad65-4701-a2d6-686290205165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (d3591d1e-7128-4832-ab76-e424a892af67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:15 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b2f3c0b4-9d37-42d6-8133-f948918a83ea tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created volume successfully. Apr 13 17:49:15 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7" returned: 0 in 0.513s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:15 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7 Apr 13 17:49:15 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (6b7ccec3-470e-401f-bc5e-88391f7456ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be23486-afa5-4906-a5ab-aeb41117b091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be23486-afa5-4906-a5ab-aeb41117b091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1763285014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c8246c-5548-4f87-a70f-50ed42a2ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:16Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083a9625-fd70-4d70-a0ca-c5b3795a2cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083a9625-fd70-4d70-a0ca-c5b3795a2cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e208364-820f-43cd-b266-2a9ffbc932a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e208364-820f-43cd-b266-2a9ffbc932a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c8246c-5548-4f87-a70f-50ed42a2ddb4', 'volume_name': 'volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006d2a64-712a-4264-abcc-27beeaa5bf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006d2a64-712a-4264-abcc-27beeaa5bf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87967086-6148-4d15-a9c2-74ab824d16f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume e6c8246c-5548-4f87-a70f-50ed42a2ddb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4', 'volume_size': 1} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1763285014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c8246c-5548-4f87-a70f-50ed42a2ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:16Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Creating volume e6c8246c-5548-4f87-a70f-50ed42a2ddb4 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:16 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:16 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-3dd2f42a-9958-49f4-ad21-693e122a0ac7" returned: 0 in 0.491s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:16 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 1073741824 Apr 13 17:49:16 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Lock "cinder-quobyte-3dd2f42a-9958-49f4-ad21-693e122a0ac7" released by "delete_volume" :: held 1.045s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Created reservations ['5c8b4455-6ae1-473c-98c5-df069cfb123e', '460581c3-045b-41be-95e2-43e50692ae93', '831fc4dd-e9fa-444a-b828-f29c1efe1f9f', '07a85ff0-03a0-4aea-8097-5148bf3274d8'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-1b27eb60-4809-4f12-a6f0-6304b95f7387-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:16 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:16 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (3009103e-cffb-409b-9c66-1b66b7f39cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e916a473-16bc-417e-af39-20200919bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-1b27eb60-4809-4f12-a6f0-6304b95f7387-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-7b18ad3c-aeff-4667-be37-f2635ac53b2c" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e916a473-16bc-417e-af39-20200919bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2023756733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc943f45-bfef-4d91-a253-4031b1a5232a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:16Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d169fa-f8b8-49d1-bd8c-2d89815eb194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d169fa-f8b8-49d1-bd8c-2d89815eb194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f844f3ca-7c35-48a5-b9a0-44ede62141d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f844f3ca-7c35-48a5-b9a0-44ede62141d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc943f45-bfef-4d91-a253-4031b1a5232a', 'volume_name': 'volume-bc943f45-bfef-4d91-a253-4031b1a5232a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b14c820-06bb-4486-a399-6e34e25f1211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b14c820-06bb-4486-a399-6e34e25f1211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cec47c-2f86-4b3c-833e-0aa295135a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume bc943f45-bfef-4d91-a253-4031b1a5232a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc943f45-bfef-4d91-a253-4031b1a5232a', 'volume_size': 1} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-7b18ad3c-aeff-4667-be37-f2635ac53b2c" acquired by "delete_snapshot" :: waited 0.046s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-1b27eb60-4809-4f12-a6f0-6304b95f7387" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-1b27eb60-4809-4f12-a6f0-6304b95f7387" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Deleting offline snapshot 1b27eb60-4809-4f12-a6f0-6304b95f7387 of volume 7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] snapshot_file for this snap is: volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62f3b21-da22-412f-9903-e8e493147bbe]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:16 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 Apr 13 17:49:16 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (119c1267-5617-4e2d-99cf-df995d76b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fa909c-c53f-4717-afc1-aeaa37ac8d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fa909c-c53f-4717-afc1-aeaa37ac8d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922815568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcce3cf5-0bd1-4977-8b20-1e3882f6a164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:17Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f1c791-941a-4ee3-b5d9-1ca81303467f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f1c791-941a-4ee3-b5d9-1ca81303467f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b488fd-2535-4d46-b34a-888f01bd632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b488fd-2535-4d46-b34a-888f01bd632d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcce3cf5-0bd1-4977-8b20-1e3882f6a164', 'volume_name': 'volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945631f-ca85-482a-9e8c-f50ca14690b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945631f-ca85-482a-9e8c-f50ca14690b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5215f07e-9433-4136-9522-0f30719b75e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume fcce3cf5-0bd1-4977-8b20-1e3882f6a164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164', 'volume_size': 1} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (2eb4a8c2-5b22-4c3e-a3b1-a2d9e6a08432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b09ddd-e910-49f2-a2ab-5fe853455c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b09ddd-e910-49f2-a2ab-5fe853455c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1402760215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54f55cc-e0a4-42e8-a1a1-53a75ff994f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:17Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc8695d-5fb8-4d33-b27e-67578de3b07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc8695d-5fb8-4d33-b27e-67578de3b07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701f286b-1cbe-473a-aa4e-92c0f5bd3de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701f286b-1cbe-473a-aa4e-92c0f5bd3de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54f55cc-e0a4-42e8-a1a1-53a75ff994f7', 'volume_name': 'volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c75063-8ec1-4b48-a998-31fd5e35d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c75063-8ec1-4b48-a998-31fd5e35d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b180cad9-f864-481e-8a98-c865be5c7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume b54f55cc-e0a4-42e8-a1a1-53a75ff994f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7', 'volume_size': 1} Apr 13 17:49:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:17 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 1073741824" returned: 0 in 0.717s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:17 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 Apr 13 17:49:17 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:17 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.660s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Deleted volume successfully. Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8c25c9d8-fecf-43db-b817-8b4f24164dec tempest-VolumesCloneNegativeTest-1779256708 None] Lock "cinder-3dd2f42a-9958-49f4-ad21-693e122a0ac7-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:17 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (f02855ab-1561-4171-998a-fb7fc6f8f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a5d688-af2f-462f-bc79-81534ddea176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387" returned: 0 in 0.637s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ddeb78-dd0c-40fd-9076-0d6d3a284190]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a5d688-af2f-462f-bc79-81534ddea176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-840410571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:17Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc7550f-d797-4eec-8ac0-24d93bcde9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc7550f-d797-4eec-8ac0-24d93bcde9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20fd3e7-dcc9-4b5e-af43-7fab8a86c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20fd3e7-dcc9-4b5e-af43-7fab8a86c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8', 'volume_name': 'volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9970b6-e78d-418a-920f-2aa9ee192de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9970b6-e78d-418a-920f-2aa9ee192de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cffbd26-3726-46ac-9906-a4bff29bf344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:17 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume 7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8', 'volume_size': 1} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:17 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c Apr 13 17:49:17 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:17 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4" returned: 0 in 0.515s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2023756733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc943f45-bfef-4d91-a253-4031b1a5232a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:16Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Creating volume bc943f45-bfef-4d91-a253-4031b1a5232a {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:17 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87967086-6148-4d15-a9c2-74ab824d16f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db59a81-837e-43a3-9062-c69287012bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:17 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a 1073741824 Apr 13 17:49:17 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:17 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 (e6c8246c-5548-4f87-a70f-50ed42a2ddb4): created successfully Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db59a81-837e-43a3-9062-c69287012bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (6b7ccec3-470e-401f-bc5e-88391f7456ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-12b3de69-0d15-4843-b790-df215ebf0601 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created volume successfully. Apr 13 17:49:17 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c" returned: 0 in 0.578s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:17 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 Apr 13 17:49:17 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:18 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a 1073741824" returned: 0 in 0.516s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:18 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a Apr 13 17:49:18 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:18 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387" returned: 0 in 0.584s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:18 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387 Apr 13 17:49:18 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:18 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a" returned: 0 in 0.544s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922815568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcce3cf5-0bd1-4977-8b20-1e3882f6a164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:17Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Creating volume fcce3cf5-0bd1-4977-8b20-1e3882f6a164 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:18 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:18 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 1073741824 Apr 13 17:49:18 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cec47c-2f86-4b3c-833e-0aa295135a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc943f45-bfef-4d91-a253-4031b1a5232a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (facedd80-6fca-4662-9be0-2315298e1ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:18 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume volume-bc943f45-bfef-4d91-a253-4031b1a5232a (bc943f45-bfef-4d91-a253-4031b1a5232a): created successfully Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (facedd80-6fca-4662-9be0-2315298e1ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (3009103e-cffb-409b-9c66-1b66b7f39cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-bff5011f-16c9-489e-b233-48fecda5908d tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created volume successfully. Apr 13 17:49:18 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c.1b27eb60-4809-4f12-a6f0-6304b95f7387" returned: 0 in 0.471s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-1b27eb60-4809-4f12-a6f0-6304b95f7387" released by "_delete_snapshot" :: held 2.351s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-7b18ad3c-aeff-4667-be37-f2635ac53b2c" released by "delete_snapshot" :: held 2.364s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:18 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Created reservations ['36fd4699-b157-44dd-adac-9e94987033e6', '7b09a3ee-311d-47e0-a063-9104fed80cb5', '7a9bd805-c050-46c0-8373-9388a3c6c4b7', '1eab7e59-c9e7-42a3-96d2-659aaa77a9a3'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:19 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Delete snapshot completed successfully. Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ee3d99a4-26a7-41c5-8928-50550672d982 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-1b27eb60-4809-4f12-a6f0-6304b95f7387-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:19 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 1073741824" returned: 0 in 0.604s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:19 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 Apr 13 17:49:19 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Flow 'volume_create_manager' (c2f23eaa-da54-4fc3-ab92-64a7b917bcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a87552-4e2e-4465-9121-542d73f7778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a87552-4e2e-4465-9121-542d73f7778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-772710273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff8abc7765b4058bbd03dad7037097e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:20Z,use_quota=True,user_id='265aef0257044778b43d97dffcafb4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c412016-b335-4651-b28f-4cc5fe254417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c412016-b335-4651-b28f-4cc5fe254417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14c89cb-7e6f-4465-9b63-6fbf1b75563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.image.glance [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Creating Keystone auth plugin from conf {{(pid=82736) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-7b18ad3c-aeff-4667-be37-f2635ac53b2c-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-7b18ad3c-aeff-4667-be37-f2635ac53b2c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-7b18ad3c-aeff-4667-be37-f2635ac53b2c" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-7b18ad3c-aeff-4667-be37-f2635ac53b2c" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7ea632-9c7e-4daa-bd3a-ff4c67b53a2b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:19 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164" returned: 0 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.823s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1402760215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54f55cc-e0a4-42e8-a1a1-53a75ff994f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:17Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Creating volume b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:19 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5215f07e-9433-4136-9522-0f30719b75e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357250d3-9ad5-4db0-9d97-fb5a17337b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:19 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c Apr 13 17:49:19 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:19 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 1073741824 Apr 13 17:49:19 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:19 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 (fcce3cf5-0bd1-4977-8b20-1e3882f6a164): created successfully Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357250d3-9ad5-4db0-9d97-fb5a17337b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (119c1267-5617-4e2d-99cf-df995d76b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:19 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3377ad50-916e-46e9-879a-da7acb5c9d04 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created volume successfully. Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14c89cb-7e6f-4465-9b63-6fbf1b75563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7', 'volume_name': 'volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7499b8e-5770-4004-99bf-b861646230b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7499b8e-5770-4004-99bf-b861646230b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783bd635-9d73-4647-8238-d53c7ad237ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:19 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Volume 9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 17:49:19 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Trying to clone 9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 from image c37de8a8-6952-44d2-a609-d35b5a83220f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]). {{(pid=82736) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 17:49:20 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Image download 20.69 MB at 20.69 MB/s Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32b624b-4a23-4c31-b4e3-e79f69ddd954]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:20 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD Apr 13 17:49:20 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:20 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c" returned: 0 in 0.538s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:20 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c Apr 13 17:49:20 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:20 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 1073741824" returned: 0 in 0.542s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:20 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 Apr 13 17:49:20 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:20 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Temporary image c37de8a8-6952-44d2-a609-d35b5a83220f is fetched for user 265aef0257044778b43d97dffcafb4b0. {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 17:49:20 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b18ad3c-aeff-4667-be37-f2635ac53b2c" returned: 0 in 0.460s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:20 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-7b18ad3c-aeff-4667-be37-f2635ac53b2c" released by "delete_volume" :: held 1.042s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7" returned: 0 in 0.426s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.486s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-840410571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a8c8669fbc47ffb471cf63b6b69364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:17Z,use_quota=True,user_id='38bbd3a6c71d4bbc9a11a02194bdb582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Creating volume 7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:20 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b180cad9-f864-481e-8a98-c865be5c7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:20 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 1073741824 Apr 13 17:49:20 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10b811d-8318-4f1b-af09-1b1231af4683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:20 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 (b54f55cc-e0a4-42e8-a1a1-53a75ff994f7): created successfully Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10b811d-8318-4f1b-af09-1b1231af4683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (2eb4a8c2-5b22-4c3e-a3b1-a2d9e6a08432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:20 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-7c8e9a41-1e02-4473-95e7-0f6c4e0afe15 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created volume successfully. Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92d7cc7-5de8-4d7c-a112-36603c14b62a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Created reservations ['2bab5cc8-82ec-4f1c-9444-8ef93e0a9515', '1d3b8ec3-271e-4bd0-859c-5bbe1b3dc67c', 'fffe9ea9-0397-4645-b571-66b605bd5baa', '5eab98db-3c24-4743-bf60-d628a4c8db0a'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:20 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD Apr 13 17:49:20 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:20 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:20 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:21 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 1073741824" returned: 0 in 0.471s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:21 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 Apr 13 17:49:21 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:21 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:21 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.511s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:21 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Deleted volume successfully. Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9aee3863-2867-493f-9def-e6abfb96f74c tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-7b18ad3c-aeff-4667-be37-f2635ac53b2c-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:21 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8" returned: 0 in 0.490s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-772710273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff8abc7765b4058bbd03dad7037097e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:20Z,use_quota=True,user_id='265aef0257044778b43d97dffcafb4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Creating volume 9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:21 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cffbd26-3726-46ac-9906-a4bff29bf344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:21 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 1073741824 Apr 13 17:49:21 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9077c5a-7bb9-4ab3-9ddf-eb5763fc445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:21 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Volume volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 (7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8): created successfully Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9077c5a-7bb9-4ab3-9ddf-eb5763fc445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Flow 'volume_create_manager' (f02855ab-1561-4171-998a-fb7fc6f8f28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:21 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-20ff4c00-b4a2-4db3-bb48-8332e69d26c2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created volume successfully. Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-31948876-82bc-443c-a15b-7ccd32ed3df8-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-31948876-82bc-443c-a15b-7ccd32ed3df8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "cinder-quobyte-31948876-82bc-443c-a15b-7ccd32ed3df8" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-31948876-82bc-443c-a15b-7ccd32ed3df8" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6266b2d-6a0b-4e1b-9a3a-9e82d1dddaaa]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:22 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 Apr 13 17:49:22 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:22 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 1073741824" returned: 0 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:22 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:22 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:22 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8" returned: 0 in 0.537s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:22 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8 Apr 13 17:49:22 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-quobyte-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7c252d-0f6d-4550-b10b-591decd40521]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:22 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 0 in 0.474s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Attempting download of c37de8a8-6952-44d2-a609-d35b5a83220f ((None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}])) to volume 9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7. {{(pid=82736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9fefb8-8f82-4945-b757-f2706e381f89]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_5j4_0xcl {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:22 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 Apr 13 17:49:22 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:22 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_5j4_0xcl Apr 13 17:49:22 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:23 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-31948876-82bc-443c-a15b-7ccd32ed3df8" returned: 0 in 0.506s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-quobyte-31948876-82bc-443c-a15b-7ccd32ed3df8" released by "delete_volume" :: held 1.085s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Created reservations ['d688dae7-cc35-4fa3-b459-b5cb387a8c34', '0a8aa3e3-87e4-4fe0-8f51-c27091fbc4d1', '337ac265-e497-43b5-badc-c8f58b68e179', '1bb3cb63-b7f1-466a-8738-ebacacf97e26'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:23 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:23 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:23 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8" returned: 0 in 0.544s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:23 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8 Apr 13 17:49:23 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:23 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_5j4_0xcl" returned: 0 in 0.510s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_5j4_0xcl {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:23 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_5j4_0xcl Apr 13 17:49:23 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:23 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.507s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:23 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Deleted volume successfully. Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b1c03bb3-59ec-41b6-affc-8a40aed69920 tempest-VolumesSnapshotTestJSON-351480142 None] Lock "cinder-31948876-82bc-443c-a15b-7ccd32ed3df8-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:23 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8" returned: 0 in 0.431s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8" released by "delete_volume" :: held 1.005s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:23 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_5j4_0xcl" returned: 1 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c37de8a8-6952-44d2-a609-d35b5a83220f_5j4_0xcl' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d40af-98d7-4866-927e-1c75cef1d2b0]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created reservations ['c4cfd668-dc9c-47ef-9fb6-28cc56bdcf98', 'f6904873-ad4d-4759-a444-4c7a1b91617f', '8c72913d-76a3-4945-9153-90d094f5aa69', '38ff8d63-ded4-40a7-a70b-1282df44e77b'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:23 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD Apr 13 17:49:23 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:23 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:24 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:24 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:24 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] c37de8a8-6952-44d2-a609-d35b5a83220f was qcow2, converting to raw {{(pid=82736) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:24 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:24 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:24 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.437s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:24 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Deleted volume successfully. Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dddfeec8-1ed8-4beb-a729-8a46e7647599 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-7cc6090a-cbfd-4092-9caf-c64ecb3c3ed8-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-quobyte-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c79c96d-ce3e-434f-8001-215de651b29f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:25 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 Apr 13 17:49:25 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:25 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 0 in 1.031s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c37de8a8-6952-44d2-a609-d35b5a83220f_oxij70cgdevstack@QuobyteHD, size 112.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:49:25 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Converted 112.00 MB image at 108.49 MB/s Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:25 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 1G Apr 13 17:49:25 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:25 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7" returned: 0 in 0.657s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:25 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7 Apr 13 17:49:25 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:25 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 1G" returned: 0 in 0.520s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:25 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfd82f1-4698-4b78-97ce-57293f53236b]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:26 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:26 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:26 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7" returned: 0 in 0.510s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7" released by "delete_volume" :: held 1.192s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created reservations ['6c6e5cb4-0a6b-4d31-99a2-d6340d8aba21', '5a1be3ba-a0fa-4b8c-95d6-c75ae00cb4d7', '2002c057-39da-4726-a223-041fdfb429ee', '15898f8b-f152-4006-ac2c-51a23ae95a56'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:26 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:26 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:26 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 0 in 0.545s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:26 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:26 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:26 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.518s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:26 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Deleted volume successfully. Apr 13 17:49:26 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-92c0cb83-1f7d-4ffe-b117-6e0ebc87f08a tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-b54f55cc-e0a4-42e8-a1a1-53a75ff994f7-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:27 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 1 in 0.574s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Downloaded image c37de8a8-6952-44d2-a609-d35b5a83220f ((None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}])) to volume 9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 successfully. {{(pid=82736) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Temporary image c37de8a8-6952-44d2-a609-d35b5a83220f for user 265aef0257044778b43d97dffcafb4b0 is deleted. {{(pid=82736) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.volume.volume_utils [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Marking volume 9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 as bootable. {{(pid=82736) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Copying metadata from image c37de8a8-6952-44d2-a609-d35b5a83220f to 9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7. {{(pid=82736) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Creating volume glance metadata for volume 9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 backed by image c37de8a8-6952-44d2-a609-d35b5a83220f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82736) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-fcce3cf5-0bd1-4977-8b20-1e3882f6a164-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-fcce3cf5-0bd1-4977-8b20-1e3882f6a164-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783bd635-9d73-4647-8238-d53c7ad237ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7', 'volume_size': 1, 'image_id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c37de8a8-6952-44d2-a609-d35b5a83220f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3d506a6bde14169925e6d6192b8c0c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c37de8a8-6952-44d2-a609-d35b5a83220f', 'created_at': datetime.datetime(2026, 4, 13, 15, 37, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c37de8a8-6952-44d2-a609-d35b5a83220f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8739aac-6dcb-4b0a-ab27-719806c8b560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:27 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Volume volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 (9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7): created successfully Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8739aac-6dcb-4b0a-ab27-719806c8b560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Flow 'volume_create_manager' (c2f23eaa-da54-4fc3-ab92-64a7b917bcb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:27 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-31d32f95-9b65-492b-a28c-3dad21735a7f tempest-VolumesExtendTest-1036861513 None] Created volume successfully. Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-quobyte-fcce3cf5-0bd1-4977-8b20-1e3882f6a164" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-fcce3cf5-0bd1-4977-8b20-1e3882f6a164" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09f4a4d-15a0-4961-b3d0-9aa4186dc0cb]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:27 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 Apr 13 17:49:27 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:27 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164" returned: 0 in 0.553s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:27 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164 Apr 13 17:49:27 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0efcd63-d6fd-428a-bee4-93de43370334]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:28 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:28 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:28 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-fcce3cf5-0bd1-4977-8b20-1e3882f6a164" returned: 0 in 0.590s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-fcce3cf5-0bd1-4977-8b20-1e3882f6a164" released by "delete_volume" :: held 1.179s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created reservations ['5556ad11-3f54-48dd-9dd3-410518953591', 'd78d3c97-1e56-48c2-b64c-39200b576d74', '1bd914c6-af21-42b1-8e1b-8f4f6ba969ef', '2050feef-7585-4efb-9151-3ac1780b7b9e'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:28 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:28 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:28 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Flow 'volume_create_manager' (17c128fb-998d-4579-9fe9-34c8bec66c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1b5498-0712-44c8-9b11-d38eb02a0d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 0 in 0.611s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1b5498-0712-44c8-9b11-d38eb02a0d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1075660352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16715222-c876-426c-a027-d11f73e3b079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8f47354ced4c4b9db2c16cc16dda81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:29Z,use_quota=True,user_id='613efa15c154478cb507cc24efed6213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea1edcc-1559-4cd7-874e-20ecbc84a3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea1edcc-1559-4cd7-874e-20ecbc84a3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1db266-6e66-429d-92f8-83e0ddf669c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1db266-6e66-429d-92f8-83e0ddf669c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16715222-c876-426c-a027-d11f73e3b079', 'volume_name': 'volume-16715222-c876-426c-a027-d11f73e3b079', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b983d5-9010-42d2-8fda-3431e8d05d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b983d5-9010-42d2-8fda-3431e8d05d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dceca3b1-e5c5-4fb0-ba1a-a10aaae36b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:28 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Volume 16715222-c876-426c-a027-d11f73e3b079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16715222-c876-426c-a027-d11f73e3b079', 'volume_size': 1} Apr 13 17:49:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:28 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:28 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:29 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.467s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:29 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Deleted volume successfully. Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c15d27d3-2d1a-4292-b942-fc19ed77a5a7 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-fcce3cf5-0bd1-4977-8b20-1e3882f6a164-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-bc943f45-bfef-4d91-a253-4031b1a5232a-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-bc943f45-bfef-4d91-a253-4031b1a5232a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:29 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 1 in 0.531s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 2G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-quobyte-bc943f45-bfef-4d91-a253-4031b1a5232a" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-bc943f45-bfef-4d91-a253-4031b1a5232a" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 2G" returned: 0 in 0.051s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.230s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1075660352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16715222-c876-426c-a027-d11f73e3b079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8f47354ced4c4b9db2c16cc16dda81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:29Z,use_quota=True,user_id='613efa15c154478cb507cc24efed6213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Creating volume 16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:29 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f1b9e-e8c4-46a0-814a-ad99a869c16b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:29 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 1073741824 Apr 13 17:49:29 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:29 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-aa89d48c-d189-4875-8ebd-2e2586ed9241 tempest-VolumesExtendTest-1036861513 None] Extend volume completed successfully. Apr 13 17:49:29 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a Apr 13 17:49:29 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:29 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:30 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a Apr 13 17:49:30 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:30 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 1073741824" returned: 0 in 0.563s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:30 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 Apr 13 17:49:30 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:30 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-bc943f45-bfef-4d91-a253-4031b1a5232a" returned: 0 in 0.455s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-bc943f45-bfef-4d91-a253-4031b1a5232a" released by "delete_volume" :: held 1.000s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created reservations ['3f79b006-7ce7-4ec9-999a-c68db86ad884', 'c8fa22b6-6f32-4ce9-96b9-8d357ae91d8d', 'cdaab0ca-68ac-4819-9746-3e395e67774b', '0433bc21-4536-4fa2-b4e1-c8c23ab49090'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:30 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Acquiring lock "cinder-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079" returned: 0 in 0.523s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Lock "cinder-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:30 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:30 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dceca3b1-e5c5-4fb0-ba1a-a10aaae36b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16715222-c876-426c-a027-d11f73e3b079', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e319e30-b635-43e2-a997-500992dd51e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:30 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Volume volume-16715222-c876-426c-a027-d11f73e3b079 (16715222-c876-426c-a027-d11f73e3b079): created successfully Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e319e30-b635-43e2-a997-500992dd51e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Flow 'volume_create_manager' (17c128fb-998d-4579-9fe9-34c8bec66c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Acquiring lock "cinder-quobyte-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:30 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-52c5f3e5-86ba-44a0-9c0e-ba678643d8bc tempest-VolumesSnapshotListTestJSON-1956320327 None] Created volume successfully. Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Lock "cinder-quobyte-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb07cbf2-7b72-49b3-a1d9-b40147f03237]: (4, 'raw') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:30 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:30 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:31 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=166,cinder:INSERT=46,cinder:UPDATE=218,cinder:DELETE=16 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:31 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Deleted volume successfully. Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Creating offline snapshot 73d0d04d-6656-4800-9e63-71944682d846 of volume 16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3f394cbe-33bd-4908-8da8-04f5fba3e580 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-bc943f45-bfef-4d91-a253-4031b1a5232a-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e74f61a-0d7e-47ca-824c-00f9b3efce98]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:31 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 Apr 13 17:49:31 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:31 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 0 in 0.596s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:31 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:31 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-e6c8246c-5548-4f87-a70f-50ed42a2ddb4-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-e6c8246c-5548-4f87-a70f-50ed42a2ddb4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-quobyte-e6c8246c-5548-4f87-a70f-50ed42a2ddb4" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-e6c8246c-5548-4f87-a70f-50ed42a2ddb4" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d869fb59-b336-4a9b-bd82-096a0ae909f4]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:31 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079" returned: 0 in 0.643s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:31 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 1G Apr 13 17:49:31 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:31 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 Apr 13 17:49:31 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:31 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 1 in 0.586s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7' failed. Not Retrying. {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 17:49:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:31 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7 Apr 13 17:49:31 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:32 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4" returned: 0 in 0.617s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:32 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 1G" returned: 0 in 0.584s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:32 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4 Apr 13 17:49:32 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:32 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 Apr 13 17:49:32 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:32 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" returned: 0 in 0.485s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Lock "cinder-quobyte-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7" released by "delete_volume" :: held 1.710s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Created reservations ['810a8da0-2c2d-456d-a519-2184ec73950f', '1d573415-0850-4021-ac0e-a21b98b98d7b', '90802350-c6cd-4a8c-971f-99caebcb7dab', 'ed60196e-1d15-45b0-b920-ad260b7151f0'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:32 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:32 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:32 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:32 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 is being set with open permissions: ugo+rw Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:32 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 Apr 13 17:49:32 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:32 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e6c8246c-5548-4f87-a70f-50ed42a2ddb4" returned: 0 in 0.603s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-e6c8246c-5548-4f87-a70f-50ed42a2ddb4" released by "delete_volume" :: held 1.264s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created reservations ['dc35630b-c122-4172-9ca0-002727fe4fcc', '98cc0f71-f659-4acf-b018-063c456e5110', 'ec310efd-5220-49cd-9bd1-a5278bf6d271', 'b4338538-d9ff-48fe-909b-18fa7e854315'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:33 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.565s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:33 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Deleted volume successfully. Apr 13 17:49:33 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:33 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-298b0458-112f-4e77-8afc-c482c9c1a33d tempest-VolumesExtendTest-1036861513 None] Lock "cinder-9a4aa51b-2d17-40ec-818d-1a1c68c4c2a7-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Flow 'volume_create_manager' (5fbfc8d0-1a64-43f9-b9f8-a858095c2cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee109ffd-3bbe-453e-bc6f-d3061887400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee109ffd-3bbe-453e-bc6f-d3061887400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-604279391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ac33c8-007d-4267-a7e0-d9e4a21ec4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff8abc7765b4058bbd03dad7037097e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:33Z,use_quota=True,user_id='265aef0257044778b43d97dffcafb4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f061c4-6a44-4a8e-9f3b-417de9ef0f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f061c4-6a44-4a8e-9f3b-417de9ef0f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c93cd5e-1f01-4b96-a9f1-858e32e58d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c93cd5e-1f01-4b96-a9f1-858e32e58d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ac33c8-007d-4267-a7e0-d9e4a21ec4be', 'volume_name': 'volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9e2e92-1fb9-4ea0-8ede-4350c7f88832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9e2e92-1fb9-4ea0-8ede-4350c7f88832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772798ec-5c9b-4697-90ec-98dcefe5652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:33 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Volume 71ac33c8-007d-4267-a7e0-d9e4a21ec4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be', 'volume_size': 1} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:33 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846" returned: 0 in 0.491s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:33 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.info Apr 13 17:49:33 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:33 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.521s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:33 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Deleted volume successfully. Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d027caf8-9469-41f6-84f7-8f99da9c8cc9 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-e6c8246c-5548-4f87-a70f-50ed42a2ddb4-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "cinder-quobyte-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0" acquired by "delete_volume" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b3af09-1a3e-4eb6-8090-0fc8b06e5c22]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:33 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.info" returned: 0 in 0.494s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:33 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.info is being set with open permissions: ugo+rw Apr 13 17:49:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:33 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.info Apr 13 17:49:33 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:33 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 Apr 13 17:49:33 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:34 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.info" returned: 0 in 0.473s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.250s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-604279391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ac33c8-007d-4267-a7e0-d9e4a21ec4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff8abc7765b4058bbd03dad7037097e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:33Z,use_quota=True,user_id='265aef0257044778b43d97dffcafb4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Creating volume 71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:34 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:34 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:34 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be 1073741824 Apr 13 17:49:34 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0" returned: 0 in 0.532s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:34 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0 Apr 13 17:49:34 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d27aa9fb-dce8-4868-ad0f-3627b5781ee5 tempest-VolumesSnapshotListTestJSON-1956320327 None] Create snapshot completed successfully Apr 13 17:49:34 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:34 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0" returned: 0 in 0.426s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-quobyte-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0" released by "delete_volume" :: held 0.983s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Created reservations ['5f1029b3-8167-4270-aa93-a2672e9e5655', 'e565a51d-0838-439d-8dff-dd2002a54cb3', 'a2ed2db6-2ecc-4be5-af0d-94e94705fbf1', '49fde5af-7d12-409b-bb65-bc17a23bc559'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:34 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be 1073741824" returned: 0 in 0.519s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:34 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:34 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:34 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be Apr 13 17:49:34 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:35 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.490s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Deleted volume successfully. Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-9b8c2ba7-7e20-4542-b4fe-f623168875f2 tempest-CreateVolumesFromSourceVolumeTest-541969764 None] Lock "cinder-7d2b6734-3cfa-4ded-ba39-372e6ae6e0a0-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:35 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.023s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772798ec-5c9b-4697-90ec-98dcefe5652d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92be64f6-640a-4548-938e-32b4d0349af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Creating offline snapshot f68fc29a-778b-4979-8092-e265683c25e3 of volume 16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:49:35 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Volume volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be (71ac33c8-007d-4267-a7e0-d9e4a21ec4be): created successfully Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92be64f6-640a-4548-938e-32b4d0349af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Flow 'volume_create_manager' (5fbfc8d0-1a64-43f9-b9f8-a858095c2cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bbc077-b9db-4c3a-9705-df67c9fc6893]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e1d3698a-106e-46c4-b3f1-8b969156a9ed tempest-VolumesExtendTest-1036861513 None] Created volume successfully. Apr 13 17:49:35 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 Apr 13 17:49:35 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:36 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846" returned: 0 in 0.588s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16715222-c876-426c-a027-d11f73e3b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:36 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 1G Apr 13 17:49:36 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:36 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 1G" returned: 0 in 0.720s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:36 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 Apr 13 17:49:36 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:37 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3" returned: 0 in 0.537s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:37 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 is being set with open permissions: ugo+rw Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:37 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 Apr 13 17:49:37 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:37 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3" returned: 0 in 0.411s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.142s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=179,cinder:INSERT=67,cinder:UPDATE=226,cinder:DELETE=22 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Creating offline snapshot 0270260b-462f-4d5d-b0bc-bf8a00874539 of volume 71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c432d-cc44-4d9b-a002-1f27dbaccff5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-57a8e960-4153-4a0b-b73c-783484683292 tempest-VolumesSnapshotListTestJSON-1956320327 None] Create snapshot completed successfully Apr 13 17:49:37 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be Apr 13 17:49:37 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:38 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" returned: 0 in 0.478s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:38 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 1G Apr 13 17:49:38 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:38 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 1G" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:38 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 Apr 13 17:49:38 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:39 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539" returned: 0 in 0.429s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:39 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 is being set with open permissions: ugo+rw Apr 13 17:49:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:39 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 Apr 13 17:49:39 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:39 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539" returned: 0 in 0.459s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:39 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.info Apr 13 17:49:39 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:40 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.info" returned: 0 in 0.416s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:40 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.info is being set with open permissions: ugo+rw Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:40 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.info Apr 13 17:49:40 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:40 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.info" returned: 0 in 0.397s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.904s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Creating offline snapshot d1d3637a-40bb-4b64-9b72-aaafb3c224ca of volume 16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:49:40 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ad105c94-64f2-4fdc-ab0e-355e5121134e tempest-VolumesExtendTest-1036861513 None] Create snapshot completed successfully Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe4f01b-37e2-433b-b2e7-45a35b67e1ed]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:40 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 Apr 13 17:49:40 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-71e2eb54-5032-446d-a756-1f882f3d98c9 tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:41 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3" returned: 0 in 0.557s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16715222-c876-426c-a027-d11f73e3b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:41 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca 1G Apr 13 17:49:41 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:41 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca 1G" returned: 0 in 0.519s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:41 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca Apr 13 17:49:41 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:42 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca" returned: 0 in 0.458s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:42 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca is being set with open permissions: ugo+rw Apr 13 17:49:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:42 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca Apr 13 17:49:42 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:42 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca" returned: 0 in 0.409s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-71e2eb54-5032-446d-a756-1f882f3d98c9 tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.693s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:42 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[604cd22a-4839-4ff2-aa26-302d00aa329a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-71e2eb54-5032-446d-a756-1f882f3d98c9 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:42 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-cf59916a-b712-4a41-97f5-f1214ab4eec6 tempest-VolumesSnapshotListTestJSON-1956320327 None] Create snapshot completed successfully Apr 13 17:49:42 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be Apr 13 17:49:42 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:43 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-71e2eb54-5032-446d-a756-1f882f3d98c9 tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" returned: 0 in 0.546s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-71e2eb54-5032-446d-a756-1f882f3d98c9 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 2G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-71e2eb54-5032-446d-a756-1f882f3d98c9 tempest-VolumesExtendTest-1036861513 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 2G" returned: 0 in 0.088s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-71e2eb54-5032-446d-a756-1f882f3d98c9 tempest-VolumesExtendTest-1036861513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.662s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:43 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-71e2eb54-5032-446d-a756-1f882f3d98c9 tempest-VolumesExtendTest-1036861513 None] Extend volume completed successfully. Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-d1d3637a-40bb-4b64-9b72-aaafb3c224ca-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-d1d3637a-40bb-4b64-9b72-aaafb3c224ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-quobyte-d1d3637a-40bb-4b64-9b72-aaafb3c224ca" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-d1d3637a-40bb-4b64-9b72-aaafb3c224ca" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Deleting offline snapshot d1d3637a-40bb-4b64-9b72-aaafb3c224ca of volume 16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] snapshot_file for this snap is: volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a5f37d-7128-49dc-bf1e-5ed143be34c8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:43 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca Apr 13 17:49:43 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:43 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca" returned: 0 in 0.471s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16715222-c876-426c-a027-d11f73e3b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aee450-9194-4c58-b18e-e8d5a67595dd]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:44 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 Apr 13 17:49:44 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Acquiring lock "cinder-0270260b-462f-4d5d-b0bc-bf8a00874539-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-0270260b-462f-4d5d-b0bc-bf8a00874539-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Acquiring lock "cinder-quobyte-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-quobyte-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Acquiring lock "cinder-quobyte-0270260b-462f-4d5d-b0bc-bf8a00874539" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-quobyte-0270260b-462f-4d5d-b0bc-bf8a00874539" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Deleting offline snapshot 0270260b-462f-4d5d-b0bc-bf8a00874539 of volume 71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] snapshot_file for this snap is: volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9468cdad-3aac-4f74-ac09-5b8ba2410257]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:44 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 Apr 13 17:49:44 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:44 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3" returned: 0 in 0.539s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16715222-c876-426c-a027-d11f73e3b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:44 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca Apr 13 17:49:44 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:44 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539" returned: 0 in 0.492s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[82006f04-13e9-4115-a50f-611223845570]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:44 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be Apr 13 17:49:44 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:44 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca" returned: 0 in 0.490s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:45 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca Apr 13 17:49:45 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:45 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" returned: 0 in 0.511s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:45 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 Apr 13 17:49:45 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:45 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.d1d3637a-40bb-4b64-9b72-aaafb3c224ca" returned: 0 in 0.418s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-d1d3637a-40bb-4b64-9b72-aaafb3c224ca" released by "_delete_snapshot" :: held 1.965s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" released by "delete_snapshot" :: held 1.978s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Created reservations ['86b21eec-4398-4c2f-b52a-804f7017f4f9', 'f8b119c7-8d4f-46b5-8495-5d4f085af3d1', 'e32909e4-c587-4da9-a87e-5cccf8f8c35e', '9c3ec832-ebd4-45dc-8c94-d4d50fbfdc93'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:45 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Delete snapshot completed successfully. Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-51d27484-0c62-48f9-8164-0feb2ac030ff tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-d1d3637a-40bb-4b64-9b72-aaafb3c224ca-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-f68fc29a-778b-4979-8092-e265683c25e3-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-f68fc29a-778b-4979-8092-e265683c25e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-quobyte-f68fc29a-778b-4979-8092-e265683c25e3" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-f68fc29a-778b-4979-8092-e265683c25e3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Deleting offline snapshot f68fc29a-778b-4979-8092-e265683c25e3 of volume 16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] snapshot_file for this snap is: volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc7bf1-5a70-4e59-aa75-c08a8930a93f]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:45 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 Apr 13 17:49:45 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:45 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539" returned: 0 in 0.504s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:45 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539 Apr 13 17:49:45 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:46 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3" returned: 0 in 0.509s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16715222-c876-426c-a027-d11f73e3b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dbd7dd-b93f-470a-8286-0a148851569b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:46 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be.0270260b-462f-4d5d-b0bc-bf8a00874539" returned: 0 in 0.429s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-quobyte-0270260b-462f-4d5d-b0bc-bf8a00874539" released by "_delete_snapshot" :: held 1.993s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:46 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 Apr 13 17:49:46 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-quobyte-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" released by "delete_snapshot" :: held 2.008s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Created reservations ['c5a418b4-bfc8-4252-96f3-5dbc210f52b4', '821874c0-b39c-42ff-baaf-972fca4b37e1', '64a39b33-83f3-4217-a118-5931d75b055f', '795c664d-f9b2-475e-9a07-e89fa246825c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:46 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Delete snapshot completed successfully. Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e6101fb-95eb-4dc6-af70-cdcf28a45cb6 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-0270260b-462f-4d5d-b0bc-bf8a00874539-delete_snapshot" released by "delete_snapshot" :: held 2.108s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:46 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846" returned: 0 in 0.505s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16715222-c876-426c-a027-d11f73e3b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:46 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 Apr 13 17:49:46 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:47 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3" returned: 0 in 0.444s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:47 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3 Apr 13 17:49:47 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Acquiring lock "cinder-71ac33c8-007d-4267-a7e0-d9e4a21ec4be-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-71ac33c8-007d-4267-a7e0-d9e4a21ec4be-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Acquiring lock "cinder-quobyte-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-quobyte-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[45648ae7-5737-446a-b9f0-31d47163ce52]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:47 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be Apr 13 17:49:47 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:47 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.f68fc29a-778b-4979-8092-e265683c25e3" returned: 0 in 0.430s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-f68fc29a-778b-4979-8092-e265683c25e3" released by "_delete_snapshot" :: held 1.932s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" released by "delete_snapshot" :: held 1.945s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Created reservations ['a34ab905-2db0-4f04-82ee-7e4110376409', '785a47d8-9cfa-4a7b-ae83-510ae1a7b966', '4cd839ce-ca1f-47fa-9c09-a94d010af36f', 'b828d51b-39de-435f-9958-231e43b9a68d'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:47 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Delete snapshot completed successfully. Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-72102c6d-c87f-4561-84f1-f04e035e5ccb tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-f68fc29a-778b-4979-8092-e265683c25e3-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-73d0d04d-6656-4800-9e63-71944682d846-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-73d0d04d-6656-4800-9e63-71944682d846-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-quobyte-73d0d04d-6656-4800-9e63-71944682d846" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-73d0d04d-6656-4800-9e63-71944682d846" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Deleting offline snapshot 73d0d04d-6656-4800-9e63-71944682d846 of volume 16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] snapshot_file for this snap is: volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb695c5-fe09-4dc4-be98-46e4ec673821]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:47 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 Apr 13 17:49:47 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:47 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" returned: 0 in 0.500s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:47 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be Apr 13 17:49:47 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:48 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846" returned: 0 in 0.535s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16715222-c876-426c-a027-d11f73e3b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a385b3c-45fb-484d-b13e-500b1ae3b88d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:48 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 Apr 13 17:49:48 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:48 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" returned: 0 in 0.470s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-quobyte-71ac33c8-007d-4267-a7e0-d9e4a21ec4be" released by "delete_volume" :: held 1.001s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Created reservations ['683cc0b8-a17f-4f30-9630-3f85fe79f2a0', 'e13c3414-5ecd-4b6b-a15f-85c4567c33c0', '2012e3f2-53ac-406e-b775-5fb598270b09', '16067bca-389b-43a2-9c80-5e90b307ed94'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:48 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:48 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:48 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079" returned: 0 in 0.481s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:48 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 Apr 13 17:49:48 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:48 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.417s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:48 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Deleted volume successfully. Apr 13 17:49:48 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a345fb12-5702-43b6-b432-10a1c4ef2597 tempest-VolumesExtendTest-1036861513 None] Lock "cinder-71ac33c8-007d-4267-a7e0-d9e4a21ec4be-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:49 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846" returned: 0 in 0.450s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:49 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846 Apr 13 17:49:49 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:49 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079.73d0d04d-6656-4800-9e63-71944682d846" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-73d0d04d-6656-4800-9e63-71944682d846" released by "_delete_snapshot" :: held 1.981s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" released by "delete_snapshot" :: held 1.997s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:49 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Created reservations ['40b9948c-0e8c-4239-8f16-b8369b80c25a', '9e9fdd89-d3f0-469c-b1a4-1d34904a184b', 'bb45283a-9334-4ed6-a1e1-09e8fbb5e296', '58848cc2-cb80-46e3-a60b-c39ea22163db'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:49 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Delete snapshot completed successfully. Apr 13 17:49:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ddd8719b-6812-4e5c-8ca4-a302df39c86b tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-73d0d04d-6656-4800-9e63-71944682d846-delete_snapshot" released by "delete_snapshot" :: held 2.108s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-16715222-c876-426c-a027-d11f73e3b079-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-16715222-c876-426c-a027-d11f73e3b079-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:49:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e0e84-b25f-445e-81d5-06ff0ac3fb70]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:51 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 Apr 13 17:49:51 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Flow 'volume_create_manager' (be4f6977-48e4-4fea-adc2-40a951768e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb221b62-d325-4e1f-82f9-f104539c16b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb221b62-d325-4e1f-82f9-f104539c16b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-728020733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b740613-6e95-4fe5-849a-8a5fc81b4aea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60fac68b0ee44293837d1cc2b57a761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:51Z,use_quota=True,user_id='7505fc6aec644ad7aee6498dd7e60964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f88b23-6771-4a34-b67d-251fffe9de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f88b23-6771-4a34-b67d-251fffe9de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef22856-f64c-4993-a119-1510c319d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef22856-f64c-4993-a119-1510c319d74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b740613-6e95-4fe5-849a-8a5fc81b4aea', 'volume_name': 'volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d465fcde-e3bd-48bb-9511-911144db9b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:51 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d465fcde-e3bd-48bb-9511-911144db9b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964b70a3-5e8e-4352-be56-363930f369a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:51 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Volume 5b740613-6e95-4fe5-849a-8a5fc81b4aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea', 'volume_size': 1} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-728020733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b740613-6e95-4fe5-849a-8a5fc81b4aea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60fac68b0ee44293837d1cc2b57a761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:51Z,use_quota=True,user_id='7505fc6aec644ad7aee6498dd7e60964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Creating volume 5b740613-6e95-4fe5-849a-8a5fc81b4aea {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:51 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079" returned: 0 in 0.601s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:51 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea 1073741824 Apr 13 17:49:51 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:51 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079 Apr 13 17:49:51 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:52 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-16715222-c876-426c-a027-d11f73e3b079" returned: 0 in 0.421s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-quobyte-16715222-c876-426c-a027-d11f73e3b079" released by "delete_volume" :: held 1.073s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Created reservations ['8df922c5-4025-4508-b4b6-0023820f4fe4', '8743ce0c-ed1d-4b5f-b1bd-cb5bdaac4d41', 'ab803edb-3c4e-4158-82a4-33db5fc53b3f', '29681c1e-59dc-4e2f-8c07-cdc149c14a18'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:52 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:49:52 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:52 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea 1073741824" returned: 0 in 0.570s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:52 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea Apr 13 17:49:52 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:52 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.453s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:49:52 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Deleted volume successfully. Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-7c1c5637-38a2-4de2-9689-327cf6d01db7 tempest-VolumesSnapshotListTestJSON-1956320327 None] Lock "cinder-16715222-c876-426c-a027-d11f73e3b079-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:49:52 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea" returned: 0 in 0.433s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964b70a3-5e8e-4352-be56-363930f369a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a420eba-5c13-4af9-8eba-8fbdc609d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:52 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Volume volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea (5b740613-6e95-4fe5-849a-8a5fc81b4aea): created successfully Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a420eba-5c13-4af9-8eba-8fbdc609d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Flow 'volume_create_manager' (be4f6977-48e4-4fea-adc2-40a951768e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:52 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-aca5b6b8-eff0-497a-b31e-b26f0fcb5eea tempest-VolumesListTestJSON-2131465975 None] Created volume successfully. Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Flow 'volume_create_manager' (30b2d7f5-5287-4f12-a65e-8cee724ca34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd167d6-c1ae-4ff4-ab19-554b70419620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd167d6-c1ae-4ff4-ab19-554b70419620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-945221986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a7b4c-bec2-4302-9fe1-04f0ad3851ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60fac68b0ee44293837d1cc2b57a761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:54Z,use_quota=True,user_id='7505fc6aec644ad7aee6498dd7e60964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efe987c-cf59-493c-8689-4aa430755e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efe987c-cf59-493c-8689-4aa430755e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e04fb7-a1b0-4254-a664-a70468938970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e04fb7-a1b0-4254-a664-a70468938970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57a7b4c-bec2-4302-9fe1-04f0ad3851ac', 'volume_name': 'volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5169758-b223-4ae3-9c54-977e2dfa2568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5169758-b223-4ae3-9c54-977e2dfa2568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f2a6f3-5de7-41f4-acba-ed5b82cb397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:53 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Volume c57a7b4c-bec2-4302-9fe1-04f0ad3851ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac', 'volume_size': 1} Apr 13 17:49:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-945221986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a7b4c-bec2-4302-9fe1-04f0ad3851ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60fac68b0ee44293837d1cc2b57a761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:54Z,use_quota=True,user_id='7505fc6aec644ad7aee6498dd7e60964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Creating volume c57a7b4c-bec2-4302-9fe1-04f0ad3851ac {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:54 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:54 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac 1073741824 Apr 13 17:49:54 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:54 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac 1073741824" returned: 0 in 0.559s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:54 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac Apr 13 17:49:54 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:55 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac" returned: 0 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f2a6f3-5de7-41f4-acba-ed5b82cb397b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf91cad-fa4e-46dc-b74a-56faf6bb846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:55 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Volume volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac (c57a7b4c-bec2-4302-9fe1-04f0ad3851ac): created successfully Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf91cad-fa4e-46dc-b74a-56faf6bb846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Flow 'volume_create_manager' (30b2d7f5-5287-4f12-a65e-8cee724ca34a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Flow 'volume_create_manager' (d18eb3b5-a74c-4e6b-a072-b4a56093d982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8683db-bac3-4858-8454-33aa9397fa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:55 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-fdd4ac46-4cd9-4447-b8d7-efb60ff65415 tempest-VolumesListTestJSON-2131465975 None] Created volume successfully. Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8683db-bac3-4858-8454-33aa9397fa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1199016744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251dd249-84c5-43c2-9500-fdbd4f5444d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4812caafdaf044fcb03279848f7df6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:55Z,use_quota=True,user_id='c587c66592b8471e8751f85553300155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0665aa-863c-4338-af0c-80c9ab04a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0665aa-863c-4338-af0c-80c9ab04a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c188820-c65c-4e9e-b64d-153fc1e53733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c188820-c65c-4e9e-b64d-153fc1e53733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251dd249-84c5-43c2-9500-fdbd4f5444d6', 'volume_name': 'volume-251dd249-84c5-43c2-9500-fdbd4f5444d6', 'volume_size': 2}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3561684c-6c71-4b22-b0ea-c3666d1179e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3561684c-6c71-4b22-b0ea-c3666d1179e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32077c8e-7d29-43b0-b73a-45e2ffa5b588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:55 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Volume 251dd249-84c5-43c2-9500-fdbd4f5444d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251dd249-84c5-43c2-9500-fdbd4f5444d6', 'volume_size': 2} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1199016744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251dd249-84c5-43c2-9500-fdbd4f5444d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4812caafdaf044fcb03279848f7df6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:55Z,use_quota=True,user_id='c587c66592b8471e8751f85553300155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Creating volume 251dd249-84c5-43c2-9500-fdbd4f5444d6 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:55 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 2147483648 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:55 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 2147483648 Apr 13 17:49:55 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:55 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 2147483648" returned: 0 in 0.502s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:55 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 Apr 13 17:49:55 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:56 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6" returned: 0 in 0.465s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32077c8e-7d29-43b0-b73a-45e2ffa5b588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251dd249-84c5-43c2-9500-fdbd4f5444d6', 'volume_size': 2}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983eaca5-8937-4e7b-88d6-6b43780d821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:56 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Volume volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 (251dd249-84c5-43c2-9500-fdbd4f5444d6): created successfully Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983eaca5-8937-4e7b-88d6-6b43780d821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Flow 'volume_create_manager' (d18eb3b5-a74c-4e6b-a072-b4a56093d982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:56 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e7608890-e048-47fe-88a7-e38ee493529f tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Created volume successfully. Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Flow 'volume_create_manager' (328efdd8-d56d-4d99-aa9f-b4bc2fe3e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c56205d-0a8e-4f3b-ab9c-23ccfe1086b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c56205d-0a8e-4f3b-ab9c-23ccfe1086b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1276826998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc63dda-cc44-4d84-84a3-4ca7af47836d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60fac68b0ee44293837d1cc2b57a761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:56Z,use_quota=True,user_id='7505fc6aec644ad7aee6498dd7e60964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62a1de9-b7ad-452e-9158-e1fc732237c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62a1de9-b7ad-452e-9158-e1fc732237c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdd24d6-a38d-40cd-81fb-a85bd6a78eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdd24d6-a38d-40cd-81fb-a85bd6a78eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc63dda-cc44-4d84-84a3-4ca7af47836d', 'volume_name': 'volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c276be53-e103-4c93-9b2b-129e348df611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c276be53-e103-4c93-9b2b-129e348df611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bd662e-434c-4d36-baf1-e42956261716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:56 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Volume 4fc63dda-cc44-4d84-84a3-4ca7af47836d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d', 'volume_size': 1} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1276826998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc63dda-cc44-4d84-84a3-4ca7af47836d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60fac68b0ee44293837d1cc2b57a761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:49:56Z,use_quota=True,user_id='7505fc6aec644ad7aee6498dd7e60964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Creating volume 4fc63dda-cc44-4d84-84a3-4ca7af47836d {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:49:56 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:56 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d 1073741824 Apr 13 17:49:56 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:56 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d 1073741824" returned: 0 in 0.498s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:56 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d Apr 13 17:49:56 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:49:57 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d" returned: 0 in 0.488s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.020s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bd662e-434c-4d36-baf1-e42956261716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4c8e91-82c1-45f3-9a09-7f99e32692a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Creating offline snapshot 113ef92f-86fc-4c88-b420-d8a38f4b6563 of volume 251dd249-84c5-43c2-9500-fdbd4f5444d6 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:49:57 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Volume volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d (4fc63dda-cc44-4d84-84a3-4ca7af47836d): created successfully Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4c8e91-82c1-45f3-9a09-7f99e32692a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Flow 'volume_create_manager' (328efdd8-d56d-4d99-aa9f-b4bc2fe3e842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa40935-b23f-4de4-aebc-7bd7aa77cce2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:49:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4cb6b44e-e78a-47f1-8956-05d3444f9751 tempest-VolumesListTestJSON-2131465975 None] Created volume successfully. Apr 13 17:49:57 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 Apr 13 17:49:57 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:58 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6" returned: 0 in 0.536s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 2G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:58 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 2G Apr 13 17:49:58 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:58 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 2G" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:58 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 Apr 13 17:49:58 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:59 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563" returned: 0 in 0.491s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:59 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 is being set with open permissions: ugo+rw Apr 13 17:49:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:59 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 Apr 13 17:49:59 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:59 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 13 17:49:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563" returned: 0 in 0.499s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:49:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:49:59 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.info Apr 13 17:49:59 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:49:59 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.info" returned: 0 in 0.437s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:00 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.info is being set with open permissions: ugo+rw Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:00 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.info Apr 13 17:50:00 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:00 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.info" returned: 0 in 0.446s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.026s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:00 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d6910935-2b37-4ced-8acf-da8834f9af87 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Create snapshot completed successfully Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "cinder-4fc63dda-cc44-4d84-84a3-4ca7af47836d-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-4fc63dda-cc44-4d84-84a3-4ca7af47836d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "cinder-quobyte-4fc63dda-cc44-4d84-84a3-4ca7af47836d" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-quobyte-4fc63dda-cc44-4d84-84a3-4ca7af47836d" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2a3a2c-825d-4dbc-8896-13d13c37b7a6]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:00 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d Apr 13 17:50:00 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:01 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d" returned: 0 in 0.465s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:01 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d Apr 13 17:50:01 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "cinder-113ef92f-86fc-4c88-b420-d8a38f4b6563-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-113ef92f-86fc-4c88-b420-d8a38f4b6563-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "cinder-quobyte-251dd249-84c5-43c2-9500-fdbd4f5444d6" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-quobyte-251dd249-84c5-43c2-9500-fdbd4f5444d6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "cinder-quobyte-113ef92f-86fc-4c88-b420-d8a38f4b6563" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-quobyte-113ef92f-86fc-4c88-b420-d8a38f4b6563" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Deleting offline snapshot 113ef92f-86fc-4c88-b420-d8a38f4b6563 of volume 251dd249-84c5-43c2-9500-fdbd4f5444d6 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] snapshot_file for this snap is: volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d5ea7d-ecad-4420-85b8-e4189be984f5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:01 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4fc63dda-cc44-4d84-84a3-4ca7af47836d" returned: 0 in 0.434s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-quobyte-4fc63dda-cc44-4d84-84a3-4ca7af47836d" released by "delete_volume" :: held 0.920s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Created reservations ['f5810387-e9e7-4c69-a361-6d8b5e9f2d3e', '8a418bb1-e34f-42ae-b0e2-dddd18eaffec', '01d2c571-844b-4220-b99b-8bd6ee8e86ba', '756f2209-c2ea-4ebc-8ca1-abdc1c8046d2'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:01 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 Apr 13 17:50:01 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:01 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:01 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "cinder-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "cinder-quobyte-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-quobyte-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[79847d8e-6a34-4e8b-8bdb-e5238634d6d6]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:02 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac Apr 13 17:50:02 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:02 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563" returned: 0 in 0.548s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-251dd249-84c5-43c2-9500-fdbd4f5444d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4f6f37-c8fb-40fb-8ba9-a94c8a420fc8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:02 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.445s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:02 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Deleted volume successfully. Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-33dc5306-ab18-4993-86fd-1148198fafbd tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-4fc63dda-cc44-4d84-84a3-4ca7af47836d-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:02 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 Apr 13 17:50:02 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:02 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac" returned: 0 in 0.503s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:02 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac Apr 13 17:50:02 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:02 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6" returned: 0 in 0.470s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:02 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 Apr 13 17:50:02 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:02 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac" returned: 0 in 0.416s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-quobyte-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac" released by "delete_volume" :: held 0.943s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Created reservations ['4fff1ea3-10f7-4149-9b16-fa4d3b5d8e9e', '447c97c1-294d-4ecb-af79-ed9c87fe6c02', '7187b46d-319a-434f-bedb-6a967f5d453c', '931adb60-6e43-43b9-bdb5-4e172c05e5c9'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:02 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:02 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "cinder-5b740613-6e95-4fe5-849a-8a5fc81b4aea-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-5b740613-6e95-4fe5-849a-8a5fc81b4aea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "cinder-quobyte-5b740613-6e95-4fe5-849a-8a5fc81b4aea" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-quobyte-5b740613-6e95-4fe5-849a-8a5fc81b4aea" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a17db-af8d-40cc-8f50-90c9ac3da0a4]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:03 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea Apr 13 17:50:03 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:03 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563" returned: 0 in 0.548s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:03 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563 Apr 13 17:50:03 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:03 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.466s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:03 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Deleted volume successfully. Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5cb13b5c-7dfe-43e8-ae48-c5b56f784036 tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-c57a7b4c-bec2-4302-9fe1-04f0ad3851ac-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:03 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea" returned: 0 in 0.546s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:03 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6.113ef92f-86fc-4c88-b420-d8a38f4b6563" returned: 0 in 0.413s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:03 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea Apr 13 17:50:03 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-quobyte-113ef92f-86fc-4c88-b420-d8a38f4b6563" released by "_delete_snapshot" :: held 2.053s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-quobyte-251dd249-84c5-43c2-9500-fdbd4f5444d6" released by "delete_snapshot" :: held 2.069s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Created reservations ['d482c97b-6df2-4c76-88ad-fd4c2ba63ad7', '224b9bcc-a96d-4515-b093-f5703fd5fe82', '68b6e749-c571-4ef1-9383-7b6455d74e3c', 'f33e4c4d-3841-464c-a17c-6c911687eaac'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:03 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Delete snapshot completed successfully. Apr 13 17:50:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-66a91303-660f-4db4-8616-291a91863ce9 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-113ef92f-86fc-4c88-b420-d8a38f4b6563-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:04 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5b740613-6e95-4fe5-849a-8a5fc81b4aea" returned: 0 in 0.481s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-quobyte-5b740613-6e95-4fe5-849a-8a5fc81b4aea" released by "delete_volume" :: held 1.054s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Created reservations ['58c62238-7bbd-463f-8c71-377b88033f95', 'a2c90acd-b0bb-4449-881b-a212e8d390ba', '627681db-0c4b-4450-9a69-0c60992f3de9', '74d07c05-37fc-4a63-a230-6f9edf234897'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:04 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:04 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:04 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.422s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:04 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Deleted volume successfully. Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4cb9008f-7806-4341-a3f0-c2b22ad0aafe tempest-VolumesListTestJSON-2131465975 None] Lock "cinder-5b740613-6e95-4fe5-849a-8a5fc81b4aea-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "cinder-251dd249-84c5-43c2-9500-fdbd4f5444d6-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-251dd249-84c5-43c2-9500-fdbd4f5444d6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "cinder-quobyte-251dd249-84c5-43c2-9500-fdbd4f5444d6" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-quobyte-251dd249-84c5-43c2-9500-fdbd4f5444d6" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead48f6f-4f80-4e70-8413-4bdf6b4c5157]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:04 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 Apr 13 17:50:04 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:05 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6" returned: 0 in 0.554s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:05 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6 Apr 13 17:50:05 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:05 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-251dd249-84c5-43c2-9500-fdbd4f5444d6" returned: 0 in 0.478s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-quobyte-251dd249-84c5-43c2-9500-fdbd4f5444d6" released by "delete_volume" :: held 1.069s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:05 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Created reservations ['a905704d-3b32-4649-90a4-c2b8a297724e', '1149c619-5031-4399-81de-acdf73a6ac1c', '3f13829b-427b-4f9c-9e35-36993a7bbcd0', 'd9a15cd7-57cb-4417-a500-220fe9d415b8'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:06 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:06 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:06 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.459s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:06 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Deleted volume successfully. Apr 13 17:50:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5e632a96-9af2-42c4-a237-1d093d56de23 tempest-VolumesSnapshotNegativeTestJSON-996869503 None] Lock "cinder-251dd249-84c5-43c2-9500-fdbd4f5444d6-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:08 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (964cc043-0e1f-49ba-a175-816c884a27fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d60c0a-caf8-472e-9000-cd412e241935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d60c0a-caf8-472e-9000-cd412e241935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1170333028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8497e6-b144-4c5a-b722-7a3d505eb037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:09Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b1db50-99cc-40b8-bcae-13f8710d7b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b1db50-99cc-40b8-bcae-13f8710d7b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bd9412-6f0c-484a-b2e1-af7c95b299df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bd9412-6f0c-484a-b2e1-af7c95b299df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8497e6-b144-4c5a-b722-7a3d505eb037', 'volume_name': 'volume-1c8497e6-b144-4c5a-b722-7a3d505eb037', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdf3977-9a6c-4351-b3db-e8cfd0e8b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdf3977-9a6c-4351-b3db-e8cfd0e8b65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83a3888-c15a-4913-a842-17a1f08aaeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:09 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume 1c8497e6-b144-4c5a-b722-7a3d505eb037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8497e6-b144-4c5a-b722-7a3d505eb037', 'volume_size': 1} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1170333028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8497e6-b144-4c5a-b722-7a3d505eb037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:09Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Creating volume 1c8497e6-b144-4c5a-b722-7a3d505eb037 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:09 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:09 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 1073741824 Apr 13 17:50:09 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:09 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 1073741824" returned: 0 in 0.497s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:09 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 Apr 13 17:50:09 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:09 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:09 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:10 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037" returned: 0 in 0.480s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83a3888-c15a-4913-a842-17a1f08aaeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8497e6-b144-4c5a-b722-7a3d505eb037', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308740ac-ef26-4f6a-979b-470f70eb1053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:10 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 (1c8497e6-b144-4c5a-b722-7a3d505eb037): created successfully Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308740ac-ef26-4f6a-979b-470f70eb1053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (964cc043-0e1f-49ba-a175-816c884a27fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:10 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-654bef0f-1721-4106-a69e-56ad2ca5b19f tempest-CreateVolumesFromSnapshotTest-446028322 None] Created volume successfully. Apr 13 17:50:10 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.458s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:10 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Creating offline snapshot 66fb1742-077b-4b94-9017-ff74d3540025 of volume 1c8497e6-b144-4c5a-b722-7a3d505eb037 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:50:11 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a584c710-ea18-42e6-8df2-b2596820f6a0]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:11 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 Apr 13 17:50:11 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:11 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037" returned: 0 in 0.479s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:11 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 1G Apr 13 17:50:11 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:12 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 1G" returned: 0 in 0.468s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:12 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 Apr 13 17:50:12 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:12 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025" returned: 0 in 0.442s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:12 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 is being set with open permissions: ugo+rw Apr 13 17:50:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:12 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 Apr 13 17:50:12 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:13 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025" returned: 0 in 0.403s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:13 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.info Apr 13 17:50:13 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:13 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.info" returned: 0 in 0.400s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:13 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.info is being set with open permissions: ugo+rw Apr 13 17:50:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:13 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.info Apr 13 17:50:13 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:13 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.info" returned: 0 in 0.385s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:13 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3533e23e-feb8-43d7-b5b8-864b67bdf08f tempest-CreateVolumesFromSnapshotTest-446028322 None] Create snapshot completed successfully Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (325e6ed9-8953-4351-89b8-417e02ec6d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4f9938-3cc7-41f1-a16c-60cf48ddfb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4f9938-3cc7-41f1-a16c-60cf48ddfb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1464290942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7056162d-ef17-408f-ab4e-b11793d823f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:14Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bb4d59-dda5-4b2b-a52d-c0fa2167ede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bb4d59-dda5-4b2b-a52d-c0fa2167ede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc224c2-cd99-4f31-93f7-dcb57f909f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc224c2-cd99-4f31-93f7-dcb57f909f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7056162d-ef17-408f-ab4e-b11793d823f2', 'volume_name': 'volume-7056162d-ef17-408f-ab4e-b11793d823f2', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b416bebf-6f9a-4a0a-b2b4-a53fee7abc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b416bebf-6f9a-4a0a-b2b4-a53fee7abc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a055deb6-fc0b-4fb5-adeb-e02a0528f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume 7056162d-ef17-408f-ab4e-b11793d823f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7056162d-ef17-408f-ab4e-b11793d823f2', 'volume_size': 1} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1464290942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7056162d-ef17-408f-ab4e-b11793d823f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:14Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Creating volume 7056162d-ef17-408f-ab4e-b11793d823f2 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:14 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:14 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 1073741824 Apr 13 17:50:14 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (129d5d51-db69-4aac-bb42-792640336d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b145c77a-8e60-42c6-bb46-d50335b71f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b145c77a-8e60-42c6-bb46-d50335b71f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-250191282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24202a05-3e0e-4947-b2c4-2c116af5da67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:15Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca646279-0561-4ebd-918e-652f8a5b892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca646279-0561-4ebd-918e-652f8a5b892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36238398-d94e-4746-91d7-0c6171e22bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36238398-d94e-4746-91d7-0c6171e22bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24202a05-3e0e-4947-b2c4-2c116af5da67', 'volume_name': 'volume-24202a05-3e0e-4947-b2c4-2c116af5da67', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006b982b-b63e-40f8-a087-e76f6ed90ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006b982b-b63e-40f8-a087-e76f6ed90ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27a5a30-5d02-4e4c-93fb-c34aaf436ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume 24202a05-3e0e-4947-b2c4-2c116af5da67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24202a05-3e0e-4947-b2c4-2c116af5da67', 'volume_size': 1} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (eeb3ce8f-3376-4278-af7b-5bbec8a854ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613e1ba2-965c-4ded-a5aa-0e5863b6ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613e1ba2-965c-4ded-a5aa-0e5863b6ca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865605020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4e916e-4a41-4975-8c28-c23cf8bf8dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:15Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0408384-1919-4a61-97f7-47608a84e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0408384-1919-4a61-97f7-47608a84e70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedae8d3-5bba-407c-b705-fddb1b2e9ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedae8d3-5bba-407c-b705-fddb1b2e9ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4e916e-4a41-4975-8c28-c23cf8bf8dbf', 'volume_name': 'volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27f6af3-7451-4430-98fb-6bfdfeaf9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27f6af3-7451-4430-98fb-6bfdfeaf9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1d8023-e94c-4a21-9d2f-b3f45efca0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:14 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume 2c4e916e-4a41-4975-8c28-c23cf8bf8dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf', 'volume_size': 1} Apr 13 17:50:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (d99c73d4-36da-4c70-bb36-bd01f4ecffe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb35108-e9ec-4499-a3b7-017b8b04a4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb35108-e9ec-4499-a3b7-017b8b04a4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1223843996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a082572-7038-4f4a-8945-9c1f2fd06351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:15Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c85433-67ff-4e89-93b3-7eec33cbf74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c85433-67ff-4e89-93b3-7eec33cbf74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60409cfc-cf41-4f11-a1f4-07e7fd70735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60409cfc-cf41-4f11-a1f4-07e7fd70735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a082572-7038-4f4a-8945-9c1f2fd06351', 'volume_name': 'volume-9a082572-7038-4f4a-8945-9c1f2fd06351', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbd57e2-3bb7-4e93-b1f8-8930e3e667f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbd57e2-3bb7-4e93-b1f8-8930e3e667f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29d1fb4-f54d-4ee1-9895-e5942704e200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume 9a082572-7038-4f4a-8945-9c1f2fd06351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a082572-7038-4f4a-8945-9c1f2fd06351', 'volume_size': 1} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 1073741824" returned: 0 in 0.591s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:15 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 Apr 13 17:50:15 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (015bdbb8-cf18-498e-8c5f-af754865ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5fb305-0375-4b39-905c-70067434d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5fb305-0375-4b39-905c-70067434d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328361234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21266444-7c6c-4f2b-8846-a4d50f0f1825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:15Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a0cd45-d5fc-4b05-b935-a1b10ab03887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a0cd45-d5fc-4b05-b935-a1b10ab03887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b34f78-4d60-46a2-b8eb-65a9ccb9ea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b34f78-4d60-46a2-b8eb-65a9ccb9ea81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21266444-7c6c-4f2b-8846-a4d50f0f1825', 'volume_name': 'volume-21266444-7c6c-4f2b-8846-a4d50f0f1825', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12a732a-228d-4c7e-bf6f-1a0e38a3e89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12a732a-228d-4c7e-bf6f-1a0e38a3e89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d840c3-b60a-4755-922d-8772c9a51bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume 21266444-7c6c-4f2b-8846-a4d50f0f1825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21266444-7c6c-4f2b-8846-a4d50f0f1825', 'volume_size': 1} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:15 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2" returned: 0 in 0.440s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-250191282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24202a05-3e0e-4947-b2c4-2c116af5da67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:15Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Creating volume 24202a05-3e0e-4947-b2c4-2c116af5da67 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:15 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a055deb6-fc0b-4fb5-adeb-e02a0528f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7056162d-ef17-408f-ab4e-b11793d823f2', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 1073741824 Apr 13 17:50:15 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f2681e-ae80-4d20-9f3f-0782a972515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:15 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume volume-7056162d-ef17-408f-ab4e-b11793d823f2 (7056162d-ef17-408f-ab4e-b11793d823f2): created successfully Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f2681e-ae80-4d20-9f3f-0782a972515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:15 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (325e6ed9-8953-4351-89b8-417e02ec6d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:15 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-628e8955-e16f-4293-a99f-493fd1505e96 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created volume successfully. Apr 13 17:50:16 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 1073741824" returned: 0 in 0.468s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:16 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 Apr 13 17:50:16 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:16 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67" returned: 0 in 0.414s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865605020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4e916e-4a41-4975-8c28-c23cf8bf8dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:15Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Creating volume 2c4e916e-4a41-4975-8c28-c23cf8bf8dbf {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:16 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27a5a30-5d02-4e4c-93fb-c34aaf436ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24202a05-3e0e-4947-b2c4-2c116af5da67', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:16 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf 1073741824 Apr 13 17:50:16 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529f6d8d-9aba-4738-bd54-5330dd83db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume volume-24202a05-3e0e-4947-b2c4-2c116af5da67 (24202a05-3e0e-4947-b2c4-2c116af5da67): created successfully Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529f6d8d-9aba-4738-bd54-5330dd83db21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (129d5d51-db69-4aac-bb42-792640336d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:16 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b256c1ec-28cd-425f-913b-a501d206d7e6 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created volume successfully. Apr 13 17:50:17 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf 1073741824" returned: 0 in 0.504s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:17 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf Apr 13 17:50:17 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:17 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf" returned: 0 in 0.415s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1223843996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a082572-7038-4f4a-8945-9c1f2fd06351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:15Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Creating volume 9a082572-7038-4f4a-8945-9c1f2fd06351 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:17 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1d8023-e94c-4a21-9d2f-b3f45efca0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:17 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 1073741824 Apr 13 17:50:17 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b5821c-86b9-4cf4-a2bb-fd215c396255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:17 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf (2c4e916e-4a41-4975-8c28-c23cf8bf8dbf): created successfully Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b5821c-86b9-4cf4-a2bb-fd215c396255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (eeb3ce8f-3376-4278-af7b-5bbec8a854ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-743e3bad-98e4-45c7-b613-11bae27dddc4 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created volume successfully. Apr 13 17:50:17 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 1073741824" returned: 0 in 0.486s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:18 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 Apr 13 17:50:18 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:18 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351" returned: 0 in 0.411s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.011s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328361234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21266444-7c6c-4f2b-8846-a4d50f0f1825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be9e2ae6d94f6586b463742349b67f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:15Z,use_quota=True,user_id='d5e12cc8eb9e482699210a05c48d43c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Creating volume 21266444-7c6c-4f2b-8846-a4d50f0f1825 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:18 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29d1fb4-f54d-4ee1-9895-e5942704e200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a082572-7038-4f4a-8945-9c1f2fd06351', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:18 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 1073741824 Apr 13 17:50:18 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59f7edc-451c-4985-ae29-a0e8db35b86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:18 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume volume-9a082572-7038-4f4a-8945-9c1f2fd06351 (9a082572-7038-4f4a-8945-9c1f2fd06351): created successfully Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59f7edc-451c-4985-ae29-a0e8db35b86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (d99c73d4-36da-4c70-bb36-bd01f4ecffe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-cc4456f3-0c81-45da-a33d-c51462821965 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created volume successfully. Apr 13 17:50:18 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 1073741824" returned: 0 in 0.493s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:18 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 Apr 13 17:50:18 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:19 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825" returned: 0 in 0.418s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d840c3-b60a-4755-922d-8772c9a51bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21266444-7c6c-4f2b-8846-a4d50f0f1825', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e74afe-4b2b-4bb0-86c0-f5c623f3aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:19 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Volume volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 (21266444-7c6c-4f2b-8846-a4d50f0f1825): created successfully Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e74afe-4b2b-4bb0-86c0-f5c623f3aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Flow 'volume_create_manager' (015bdbb8-cf18-498e-8c5f-af754865ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:19 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-97ed11b3-2423-40af-8261-86190cc9550c tempest-CreateVolumesFromSnapshotTest-446028322 None] Created volume successfully. Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-21266444-7c6c-4f2b-8846-a4d50f0f1825-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-21266444-7c6c-4f2b-8846-a4d50f0f1825-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-quobyte-21266444-7c6c-4f2b-8846-a4d50f0f1825" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-21266444-7c6c-4f2b-8846-a4d50f0f1825" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf205c1-f451-4862-9163-fe1c02c0382e]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:19 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 Apr 13 17:50:19 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:20 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825" returned: 0 in 0.458s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:20 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825 Apr 13 17:50:20 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:20 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-21266444-7c6c-4f2b-8846-a4d50f0f1825" returned: 0 in 0.416s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-21266444-7c6c-4f2b-8846-a4d50f0f1825" released by "delete_volume" :: held 0.899s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Created reservations ['c06887eb-ce11-467b-8294-1b98684087db', 'fc18e822-28c0-431f-8816-68e6841e6856', '4b5ae17e-f498-4421-a2f0-e97eb44e46e7', '0a4b70e1-e6ea-4828-9fe0-512120c00b48'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:20 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:20 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-9a082572-7038-4f4a-8945-9c1f2fd06351-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-9a082572-7038-4f4a-8945-9c1f2fd06351-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-quobyte-9a082572-7038-4f4a-8945-9c1f2fd06351" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-9a082572-7038-4f4a-8945-9c1f2fd06351" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59b6d70-1c12-4823-983d-0e5bf09c2557]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:21 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 Apr 13 17:50:21 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:21 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.448s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:21 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Deleted volume successfully. Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3deacdfe-13ec-4aaa-a317-7025ae02738b tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-21266444-7c6c-4f2b-8846-a4d50f0f1825-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:21 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351" returned: 0 in 0.484s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:21 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351 Apr 13 17:50:21 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:21 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9a082572-7038-4f4a-8945-9c1f2fd06351" returned: 0 in 0.424s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-9a082572-7038-4f4a-8945-9c1f2fd06351" released by "delete_volume" :: held 0.931s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created reservations ['73302f88-7a18-42ca-8511-0e2f3df3feff', '1b9b0db3-b199-48dc-a7ca-cc6246aff893', '76f8cb61-c3f0-434d-af50-40b83396f124', '812a5001-3880-4fe9-8238-eb8d2046277a'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:21 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:21 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-quobyte-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf" acquired by "delete_volume" :: waited 0.015s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db31759-807e-4f48-b04e-cb081ec53cfc]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:22 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf Apr 13 17:50:22 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:22 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.467s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:22 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Deleted volume successfully. Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-37fb964c-6ec5-45e7-a00b-e72c170741a5 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-9a082572-7038-4f4a-8945-9c1f2fd06351-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:22 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf" returned: 0 in 0.480s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:22 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf Apr 13 17:50:22 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:22 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf" returned: 0 in 0.403s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf" released by "delete_volume" :: held 0.905s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:22 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created reservations ['a47cf4ea-1d5a-40a1-a856-4fae99e256e2', 'd632cc3b-b81e-47b6-86ea-158720615e8f', 'c59dcd64-bdac-4fb5-8c3e-308e1a8529c3', '2591220e-d899-4b49-ad9c-c0193799254d'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:23 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:23 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-24202a05-3e0e-4947-b2c4-2c116af5da67-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-24202a05-3e0e-4947-b2c4-2c116af5da67-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-quobyte-24202a05-3e0e-4947-b2c4-2c116af5da67" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-24202a05-3e0e-4947-b2c4-2c116af5da67" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb55f79-db76-48d6-aa06-d6f98013b96a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:23 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 Apr 13 17:50:23 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:23 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.452s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:23 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Deleted volume successfully. Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-91299f6e-143d-47b6-97b8-a977b33c7d42 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-2c4e916e-4a41-4975-8c28-c23cf8bf8dbf-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:23 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67" returned: 0 in 0.491s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:23 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67 Apr 13 17:50:23 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:24 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-24202a05-3e0e-4947-b2c4-2c116af5da67" returned: 0 in 0.410s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-24202a05-3e0e-4947-b2c4-2c116af5da67" released by "delete_volume" :: held 0.939s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created reservations ['55b69378-7b97-4b78-a047-3f317e441b35', 'a51e404e-ef04-4be8-a7d9-7fd994e8cfb6', '49a43a81-8a29-412c-8b61-c78b1d0c6961', '6fd6783b-ae9a-4889-9100-a02ae295c3fc'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:24 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:24 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-7056162d-ef17-408f-ab4e-b11793d823f2-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-7056162d-ef17-408f-ab4e-b11793d823f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-quobyte-7056162d-ef17-408f-ab4e-b11793d823f2" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-7056162d-ef17-408f-ab4e-b11793d823f2" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d2f621-8ad1-4296-b493-db4f44cb03e0]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:24 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 Apr 13 17:50:24 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:24 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.455s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:24 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Deleted volume successfully. Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c6c1af55-c93d-471d-a1a7-f4265bf4dd11 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-24202a05-3e0e-4947-b2c4-2c116af5da67-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:24 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2" returned: 0 in 0.463s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:24 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2 Apr 13 17:50:24 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:25 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7056162d-ef17-408f-ab4e-b11793d823f2" returned: 0 in 0.388s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-7056162d-ef17-408f-ab4e-b11793d823f2" released by "delete_volume" :: held 0.873s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created reservations ['94d5536c-19ef-4309-ab18-268f47166e62', 'bc151866-c444-4f19-b69c-8b77321b4566', '25c841ef-88a9-42fe-a4e1-c41af66929cc', '704dfd44-168c-48d7-b20c-4440a671e85b'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:25 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:25 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-66fb1742-077b-4b94-9017-ff74d3540025-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-66fb1742-077b-4b94-9017-ff74d3540025-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-quobyte-1c8497e6-b144-4c5a-b722-7a3d505eb037" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-1c8497e6-b144-4c5a-b722-7a3d505eb037" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-quobyte-66fb1742-077b-4b94-9017-ff74d3540025" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-66fb1742-077b-4b94-9017-ff74d3540025" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Deleting offline snapshot 66fb1742-077b-4b94-9017-ff74d3540025 of volume 1c8497e6-b144-4c5a-b722-7a3d505eb037 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] snapshot_file for this snap is: volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec44f84-edaa-4604-8f2d-8e9523aee2e9]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:25 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 Apr 13 17:50:25 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:25 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.445s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:25 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Deleted volume successfully. Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-20a7213e-6c75-4e96-94c1-dbceb52a0e43 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-7056162d-ef17-408f-ab4e-b11793d823f2-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:25 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025" returned: 0 in 0.475s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8497e6-b144-4c5a-b722-7a3d505eb037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4a5d16-b5fa-4481-bba2-2a3069d35112]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:25 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 Apr 13 17:50:25 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:26 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037" returned: 0 in 0.483s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:26 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 Apr 13 17:50:26 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:26 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025" returned: 0 in 0.447s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:26 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025 Apr 13 17:50:26 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:27 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037.66fb1742-077b-4b94-9017-ff74d3540025" returned: 0 in 0.420s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-66fb1742-077b-4b94-9017-ff74d3540025" released by "_delete_snapshot" :: held 1.885s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-1c8497e6-b144-4c5a-b722-7a3d505eb037" released by "delete_snapshot" :: held 1.897s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Created reservations ['5de4dec5-5902-4942-b8ed-d0025acc8426', '3c6ab1b9-a7b4-4487-ade2-0a952399069c', '83ca9653-605a-4fe1-abd6-2968dba431d9', '1917acc5-7f15-452d-a88e-c382725fb529'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:27 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Delete snapshot completed successfully. Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a463b792-cff2-4208-bf04-ba603570bd62 tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-66fb1742-077b-4b94-9017-ff74d3540025-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-1c8497e6-b144-4c5a-b722-7a3d505eb037-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-1c8497e6-b144-4c5a-b722-7a3d505eb037-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "cinder-quobyte-1c8497e6-b144-4c5a-b722-7a3d505eb037" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-1c8497e6-b144-4c5a-b722-7a3d505eb037" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8147cb07-55fd-42ce-aa0d-e9cb84191fb2]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:27 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 Apr 13 17:50:27 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:28 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037" returned: 0 in 0.472s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:28 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037 Apr 13 17:50:28 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:28 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1c8497e6-b144-4c5a-b722-7a3d505eb037" returned: 0 in 0.429s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-quobyte-1c8497e6-b144-4c5a-b722-7a3d505eb037" released by "delete_volume" :: held 0.934s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Created reservations ['da93d1c1-a936-459c-8b51-e5fcae594c5b', 'f3422b8d-fb1b-4e27-a650-633f6654eb5f', '6007a9c9-0328-43a0-8c77-4c88945922ad', 'c2d55d0f-28a3-485f-b26d-08ffb718fe5f'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:28 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:28 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:29 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:29 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:29 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Deleted volume successfully. Apr 13 17:50:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-05288bd4-951f-47fe-bdf0-6ca1924451ef tempest-CreateVolumesFromSnapshotTest-446028322 None] Lock "cinder-1c8497e6-b144-4c5a-b722-7a3d505eb037-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:DELETE=13,cinder:UPDATE=200,cinder:SELECT=147,cinder:INSERT=58 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (303daaf2-9e33-4d5d-b5cc-f25fe2161024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfbed2d-0360-431f-aa4c-099c25e2c24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfbed2d-0360-431f-aa4c-099c25e2c24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222217168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d1de8e-7005-43f6-a647-3677941f8511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:36Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4fd4fc-7380-4e0e-9fa1-db2146b35620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4fd4fc-7380-4e0e-9fa1-db2146b35620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca911059-f4cc-4e31-a0ab-f7277bf115ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca911059-f4cc-4e31-a0ab-f7277bf115ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d1de8e-7005-43f6-a647-3677941f8511', 'volume_name': 'volume-c9d1de8e-7005-43f6-a647-3677941f8511', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a903f7f7-bef1-452c-93d9-ae79184546bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a903f7f7-bef1-452c-93d9-ae79184546bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ef6fa6-01f6-4c04-bc24-125a3b21238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume c9d1de8e-7005-43f6-a647-3677941f8511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d1de8e-7005-43f6-a647-3677941f8511', 'volume_size': 1} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222217168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d1de8e-7005-43f6-a647-3677941f8511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:36Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Creating volume c9d1de8e-7005-43f6-a647-3677941f8511 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:36 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:36 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 1073741824 Apr 13 17:50:36 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (1c0f9fb0-c583-4802-bdf5-cd5fe55d4ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355ba98d-4a8c-4922-bb03-ca1875261ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355ba98d-4a8c-4922-bb03-ca1875261ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2037845186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8de46c5-e971-47a2-8aef-86f4374d51cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:36Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67dba4c-2b26-487e-bd36-8966a9ba1ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67dba4c-2b26-487e-bd36-8966a9ba1ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d99ecf-20e4-4220-bb0a-8bf6e8a1a0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d99ecf-20e4-4220-bb0a-8bf6e8a1a0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8de46c5-e971-47a2-8aef-86f4374d51cc', 'volume_name': 'volume-f8de46c5-e971-47a2-8aef-86f4374d51cc', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ed97c-786e-421f-a362-80ab21dad939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ed97c-786e-421f-a362-80ab21dad939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68674c9-97f0-467f-9299-a1d643b08c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Volume f8de46c5-e971-47a2-8aef-86f4374d51cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8de46c5-e971-47a2-8aef-86f4374d51cc', 'volume_size': 1} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Flow 'volume_create_manager' (c87ff85b-3f7a-4c44-a935-b7684bafad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c92fe42-0af8-4489-91d7-9c0406b9f902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c92fe42-0af8-4489-91d7-9c0406b9f902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-886026771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abc957e-78b0-4a96-a936-ab637cfc7f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e006dde5b6b4d76a98da60b351b6d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:36Z,use_quota=True,user_id='5e3e16ca8d594b1bb513464d40b178b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbfbe8d-9aa2-42b3-a935-42508dbdd902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbfbe8d-9aa2-42b3-a935-42508dbdd902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064bd613-1fd1-4b85-bae3-220e2587a050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064bd613-1fd1-4b85-bae3-220e2587a050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abc957e-78b0-4a96-a936-ab637cfc7f4c', 'volume_name': 'volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d573165d-4fd1-4e32-b8d6-a4f3b7a6bb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d573165d-4fd1-4e32-b8d6-a4f3b7a6bb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1b37d2-4e14-420d-b503-97a1e5644e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Volume 2abc957e-78b0-4a96-a936-ab637cfc7f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c', 'volume_size': 1} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (668b413b-2c34-4fb7-99e8-ce85c6bd9f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74215a15-943b-4f5e-8a6b-e150f8b4963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74215a15-943b-4f5e-8a6b-e150f8b4963b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1499096085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf76dfaf-3106-43f7-b324-98c4fc273eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:37Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552a8a78-86cf-4a1d-8c5f-e4f892067350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552a8a78-86cf-4a1d-8c5f-e4f892067350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d6c164-5223-44fa-a7ae-90289e9851b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d6c164-5223-44fa-a7ae-90289e9851b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf76dfaf-3106-43f7-b324-98c4fc273eb0', 'volume_name': 'volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642b2235-7cd6-4219-9a85-e86a61474a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642b2235-7cd6-4219-9a85-e86a61474a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54b97bc-bd11-49ff-828c-dadc5f927b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Volume cf76dfaf-3106-43f7-b324-98c4fc273eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0', 'volume_size': 1} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (9eda95e4-afe1-4c1a-a65a-ce0bae18a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb43ca0d-fc10-4d13-8b02-3125d997f594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb43ca0d-fc10-4d13-8b02-3125d997f594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819577622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4edda15e-df9c-4aff-a16d-3ce48b45ad83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:37Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0156a4a2-719e-4fd2-8c25-e526a515684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0156a4a2-719e-4fd2-8c25-e526a515684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d397876-d528-459c-9495-8e9ed9c44451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d397876-d528-459c-9495-8e9ed9c44451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4edda15e-df9c-4aff-a16d-3ce48b45ad83', 'volume_name': 'volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24bdee3-c01d-49aa-a628-4d355dd834c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24bdee3-c01d-49aa-a628-4d355dd834c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f3453a-5597-4b17-a361-4a849d95ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:36 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Volume 4edda15e-df9c-4aff-a16d-3ce48b45ad83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83', 'volume_size': 1} Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:36 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 1073741824" returned: 0 in 0.812s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:37 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 Apr 13 17:50:37 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (e9d0df2e-c476-4473-ae6a-c21dc6eda59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af377bbf-100a-41b5-80a3-2ec45c634764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af377bbf-100a-41b5-80a3-2ec45c634764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1238069349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d6ffec-8e4b-4194-bf70-35ef0f7e747f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:37Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5becccea-f336-4c17-8cc4-0871e0e4896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5becccea-f336-4c17-8cc4-0871e0e4896a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386a8d38-fdff-49ea-81f0-1de3334e2b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386a8d38-fdff-49ea-81f0-1de3334e2b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d6ffec-8e4b-4194-bf70-35ef0f7e747f', 'volume_name': 'volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec753f7-206b-4e99-9cdd-b52155a8d88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec753f7-206b-4e99-9cdd-b52155a8d88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5354e0b-82db-406f-ad74-540dc9b809e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Volume 94d6ffec-8e4b-4194-bf70-35ef0f7e747f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f', 'volume_size': 1} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (14fa421e-4358-4bf9-9249-fdcdbad7bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eacb1d8-a965-4a18-8d23-a63b004095b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eacb1d8-a965-4a18-8d23-a63b004095b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061062865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfde32ff-4c6e-40b6-a7bc-8d793aa7951c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:37Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db6926d-0967-49b3-9c36-cb2d1f102e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db6926d-0967-49b3-9c36-cb2d1f102e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327fd171-3409-4dc1-828a-1dc9406bc7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327fd171-3409-4dc1-828a-1dc9406bc7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfde32ff-4c6e-40b6-a7bc-8d793aa7951c', 'volume_name': 'volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7111b16-4a57-4715-9d87-b27f7cbb3739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7111b16-4a57-4715-9d87-b27f7cbb3739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7737c034-667d-4627-9703-bb37f15897d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Volume cfde32ff-4c6e-40b6-a7bc-8d793aa7951c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c', 'volume_size': 1} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:37 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511" returned: 0 in 0.557s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2037845186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8de46c5-e971-47a2-8aef-86f4374d51cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:36Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Creating volume f8de46c5-e971-47a2-8aef-86f4374d51cc {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:37 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ef6fa6-01f6-4c04-bc24-125a3b21238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d1de8e-7005-43f6-a647-3677941f8511', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440b27d6-3313-48a8-b331-99f4efe7aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:37 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume volume-c9d1de8e-7005-43f6-a647-3677941f8511 (c9d1de8e-7005-43f6-a647-3677941f8511): created successfully Apr 13 17:50:37 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc 1073741824 Apr 13 17:50:37 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440b27d6-3313-48a8-b331-99f4efe7aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:37 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (303daaf2-9e33-4d5d-b5cc-f25fe2161024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c302cd2f-56c2-437c-b327-df3dbd786395 tempest-CreateVolumesFromSnapshotTest-859567379 None] Created volume successfully. Apr 13 17:50:38 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc 1073741824" returned: 0 in 0.589s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:DELETE=17,cinder:SELECT=131,cinder:UPDATE=166,cinder:INSERT=34 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:38 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc Apr 13 17:50:38 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:38 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc" returned: 0 in 0.509s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.155s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-886026771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abc957e-78b0-4a96-a936-ab637cfc7f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e006dde5b6b4d76a98da60b351b6d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:36Z,use_quota=True,user_id='5e3e16ca8d594b1bb513464d40b178b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Creating volume 2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:38 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:38 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c 1073741824 Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68674c9-97f0-467f-9299-a1d643b08c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8de46c5-e971-47a2-8aef-86f4374d51cc', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:38 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb50cdb4-684e-4ab6-8833-951511b9f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:38 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Volume volume-f8de46c5-e971-47a2-8aef-86f4374d51cc (f8de46c5-e971-47a2-8aef-86f4374d51cc): created successfully Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb50cdb4-684e-4ab6-8833-951511b9f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:38 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (1c0f9fb0-c583-4802-bdf5-cd5fe55d4ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ed81c5fa-244b-475f-a4b3-d8dd331cf6a0 tempest-CreateVolumesFromImageTest-655271679 None] Created volume successfully. Apr 13 17:50:39 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c 1073741824" returned: 0 in 0.513s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:39 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c Apr 13 17:50:39 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:39 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c" returned: 0 in 0.512s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1499096085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf76dfaf-3106-43f7-b324-98c4fc273eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:37Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Creating volume cf76dfaf-3106-43f7-b324-98c4fc273eb0 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:39 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:39 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 1073741824 Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1b37d2-4e14-420d-b503-97a1e5644e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:39 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7522f8-9c24-41ff-9de4-78d5c8173fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:39 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Volume volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c (2abc957e-78b0-4a96-a936-ab637cfc7f4c): created successfully Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7522f8-9c24-41ff-9de4-78d5c8173fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:39 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Flow 'volume_create_manager' (c87ff85b-3f7a-4c44-a935-b7684bafad4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:39 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-394271c8-3cc5-43fc-af60-2bf4598ea9c9 tempest-VolumeDependencyTests-2020647289 None] Created volume successfully. Apr 13 17:50:40 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 1073741824" returned: 0 in 0.558s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:40 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 Apr 13 17:50:40 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:40 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0" returned: 0 in 0.501s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.976s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819577622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4edda15e-df9c-4aff-a16d-3ce48b45ad83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:37Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Creating volume 4edda15e-df9c-4aff-a16d-3ce48b45ad83 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:40 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54b97bc-bd11-49ff-828c-dadc5f927b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c45b5a9-ccc4-44c8-af4c-ef3283372949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:40 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 1073741824 Apr 13 17:50:40 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:40 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Volume volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 (cf76dfaf-3106-43f7-b324-98c4fc273eb0): created successfully Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c45b5a9-ccc4-44c8-af4c-ef3283372949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:40 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (668b413b-2c34-4fb7-99e8-ce85c6bd9f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:40 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2573572f-dedb-4f33-84cc-5021f1ed2239 tempest-CreateVolumesFromImageTest-655271679 None] Created volume successfully. Apr 13 17:50:41 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 1073741824" returned: 0 in 0.541s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:41 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 Apr 13 17:50:41 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:41 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83" returned: 0 in 0.433s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.730s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1238069349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d6ffec-8e4b-4194-bf70-35ef0f7e747f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:37Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Creating volume 94d6ffec-8e4b-4194-bf70-35ef0f7e747f {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:41 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f3453a-5597-4b17-a361-4a849d95ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:41 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f 1073741824 Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6cc04e-2482-407a-80e0-4dbcc24f32f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:41 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:41 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Volume volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 (4edda15e-df9c-4aff-a16d-3ce48b45ad83): created successfully Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6cc04e-2482-407a-80e0-4dbcc24f32f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:41 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (9eda95e4-afe1-4c1a-a65a-ce0bae18a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:41 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6cddf091-bff4-4dc2-aa4b-7d8adbe6a168 tempest-CreateVolumesFromImageTest-655271679 None] Created volume successfully. Apr 13 17:50:42 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f 1073741824" returned: 0 in 0.634s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:42 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:42 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f Apr 13 17:50:42 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:43 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f" returned: 0 in 0.507s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.575s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061062865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfde32ff-4c6e-40b6-a7bc-8d793aa7951c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f0958f5d2e418680f8d23119f47857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:37Z,use_quota=True,user_id='a6ff442a85c743668287808a9bb3d791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Creating volume cfde32ff-4c6e-40b6-a7bc-8d793aa7951c {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:43 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5354e0b-82db-406f-ad74-540dc9b809e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33dee188-e530-4d11-9bf8-8fc910f3e9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:43 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c 1073741824 Apr 13 17:50:43 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:43 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Volume volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f (94d6ffec-8e4b-4194-bf70-35ef0f7e747f): created successfully Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33dee188-e530-4d11-9bf8-8fc910f3e9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (e9d0df2e-c476-4473-ae6a-c21dc6eda59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:43 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-677ed507-058c-4c2f-b703-9140ada75d2c tempest-CreateVolumesFromImageTest-655271679 None] Created volume successfully. Apr 13 17:50:43 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c 1073741824" returned: 0 in 0.634s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:43 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:43 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c Apr 13 17:50:43 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:44 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c" returned: 0 in 0.482s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.699s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Creating offline snapshot 320e3d96-9a28-41e8-941e-9fd8bbcff89a of volume c9d1de8e-7005-43f6-a647-3677941f8511 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7737c034-667d-4627-9703-bb37f15897d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9845bd90-306d-46f0-b514-9c5302520f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5ae345-3735-4b76-8848-9707a32be2cd]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:44 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Volume volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c (cfde32ff-4c6e-40b6-a7bc-8d793aa7951c): created successfully Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9845bd90-306d-46f0-b514-9c5302520f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Flow 'volume_create_manager' (14fa421e-4358-4bf9-9249-fdcdbad7bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:44 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-61ebd80e-0588-4145-8006-71100f7d7c12 tempest-CreateVolumesFromImageTest-655271679 None] Created volume successfully. Apr 13 17:50:44 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 Apr 13 17:50:44 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:44 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511" returned: 0 in 0.532s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:44 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:44 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a 1G Apr 13 17:50:44 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-quobyte-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9becb-1cd5-46bc-a38e-95ce9575e105]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:45 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c Apr 13 17:50:45 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:45 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a 1G" returned: 0 in 0.637s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d1de8e-7005-43f6-a647-3677941f8511 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:45 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d1de8e-7005-43f6-a647-3677941f8511 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a Apr 13 17:50:45 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:45 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c" returned: 0 in 0.657s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:45 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c Apr 13 17:50:45 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:45 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d1de8e-7005-43f6-a647-3677941f8511 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:45 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a is being set with open permissions: ugo+rw Apr 13 17:50:45 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:45 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a Apr 13 17:50:45 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:46 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c" returned: 0 in 0.641s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c" released by "delete_volume" :: held 1.326s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:46 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a" returned: 0 in 0.559s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Created reservations ['aac76238-4073-490d-9f20-549755a94f92', '825945ec-671e-4321-9b4c-72c875ae91cf', '28412731-9c9d-482a-8391-00df48510119', '4084cabe-467d-4038-91a0-f915b8fa40a3'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:46 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:46 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:46 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:46 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.info Apr 13 17:50:46 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:47 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.492s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:47 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Deleted volume successfully. Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d17ff03d-5c2b-4d0c-9134-663638941c40 tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-cfde32ff-4c6e-40b6-a7bc-8d793aa7951c-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:47 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.info" returned: 0 in 0.547s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:47 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.info is being set with open permissions: ugo+rw Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:47 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.info Apr 13 17:50:47 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-94d6ffec-8e4b-4194-bf70-35ef0f7e747f-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-94d6ffec-8e4b-4194-bf70-35ef0f7e747f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-quobyte-94d6ffec-8e4b-4194-bf70-35ef0f7e747f" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-94d6ffec-8e4b-4194-bf70-35ef0f7e747f" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4493f00-ad20-466a-ae89-42a7f5d0a02b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:47 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f Apr 13 17:50:47 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:47 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.info" returned: 0 in 0.578s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.510s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.974s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Creating offline snapshot 5135e4e9-da54-4d67-936b-6588e2177221 of volume 2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:50:47 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-8ffb0b2d-c7b8-45b9-89d8-562d3008e1bc tempest-CreateVolumesFromSnapshotTest-859567379 None] Create snapshot completed successfully Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[37efb44d-595b-4818-89d7-92f1bc1874ce]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:47 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:47 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c Apr 13 17:50:47 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (d32b1660-e9a0-433c-b609-6d43b54fd942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8717111c-ec11-4f3d-9658-8c34473ba8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8717111c-ec11-4f3d-9658-8c34473ba8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490110452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0181c3-9187-4703-9ccc-a0e4db5b8f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:48Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826d3e57-5ca5-4026-ace2-645ca0477a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826d3e57-5ca5-4026-ace2-645ca0477a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f220408-2cfa-4720-8e15-48ed5ee5ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f220408-2cfa-4720-8e15-48ed5ee5ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0181c3-9187-4703-9ccc-a0e4db5b8f77', 'volume_name': 'volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f21ffd-9474-443b-a564-23dcd99b6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f21ffd-9474-443b-a564-23dcd99b6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cbb2cc-d993-40b9-8a7a-34d8193fdd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume 7b0181c3-9187-4703-9ccc-a0e4db5b8f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77', 'volume_size': 1} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f" returned: 0 in 0.937s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:48 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f Apr 13 17:50:48 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (bddebf7e-46db-46c3-bd8b-5d10c5990150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741bfa8e-fca2-47dd-8181-f445e7dad0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741bfa8e-fca2-47dd-8181-f445e7dad0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132285727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d42f44f-3d1c-48a9-a404-1be70e178993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:48Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a351820b-7948-4311-9e17-c08e1e8aad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a351820b-7948-4311-9e17-c08e1e8aad43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9630a7-7afd-44f2-9942-86c88af919e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9630a7-7afd-44f2-9942-86c88af919e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d42f44f-3d1c-48a9-a404-1be70e178993', 'volume_name': 'volume-7d42f44f-3d1c-48a9-a404-1be70e178993', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab563bce-4803-4cc5-8c2d-f448e82db5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab563bce-4803-4cc5-8c2d-f448e82db5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ae238a-5e0b-400d-b9ac-acb5930c45c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume 7d42f44f-3d1c-48a9-a404-1be70e178993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d42f44f-3d1c-48a9-a404-1be70e178993', 'volume_size': 1} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c" returned: 0 in 0.882s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:48 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 1G Apr 13 17:50:48 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (74401d6b-2442-40e1-b8fa-77ec33be0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707f698d-9a25-43e0-9fe4-4acace787d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707f698d-9a25-43e0-9fe4-4acace787d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141038975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c662ce-efdd-4399-8eff-73de936457eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:49Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8314997a-09be-4ef2-9552-b782dc091a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8314997a-09be-4ef2-9552-b782dc091a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8089fb-7b1f-4115-be86-c755e8888991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8089fb-7b1f-4115-be86-c755e8888991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c662ce-efdd-4399-8eff-73de936457eb', 'volume_name': 'volume-a5c662ce-efdd-4399-8eff-73de936457eb', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0287308a-b9c8-47c0-8c25-d477b696ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0287308a-b9c8-47c0-8c25-d477b696ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e409812-df2b-438d-b0f7-5fc249e893eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:48 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume a5c662ce-efdd-4399-8eff-73de936457eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c662ce-efdd-4399-8eff-73de936457eb', 'volume_size': 1} Apr 13 17:50:48 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (ee90baaf-dce8-4e8c-8927-f8ea289620e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa085963-3bb2-4687-bb87-e492908b9a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa085963-3bb2-4687-bb87-e492908b9a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-687761718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a3c2d2-e7a0-4ed5-b513-787f58c892ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:49Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab044f85-3e04-4ab1-b04b-034cb778c083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab044f85-3e04-4ab1-b04b-034cb778c083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae4dc45-02c6-4652-a3de-faad53f59da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae4dc45-02c6-4652-a3de-faad53f59da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a3c2d2-e7a0-4ed5-b513-787f58c892ca', 'volume_name': 'volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a531a62-bbdb-471e-95a7-97e5a3ad4212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a531a62-bbdb-471e-95a7-97e5a3ad4212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7b9efc-ff70-4294-b332-5489fbd47016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume 93a3c2d2-e7a0-4ed5-b513-787f58c892ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca', 'volume_size': 1} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:49 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 1G" returned: 0 in 0.786s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:49 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 Apr 13 17:50:49 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (d70ab627-633f-418c-9c3c-df798c8d45ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:49 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb8a990-9c36-4a53-b1e0-8ce768f4fbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-94d6ffec-8e4b-4194-bf70-35ef0f7e747f" returned: 0 in 1.136s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb8a990-9c36-4a53-b1e0-8ce768f4fbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1093132142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78bc75c-02f0-4050-94ed-ef6fe33fdae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:49Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b56f0e-b09b-490f-ae23-e3b539c0ae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b56f0e-b09b-490f-ae23-e3b539c0ae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00507bef-eb15-4c24-8a70-1c1cad06f4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00507bef-eb15-4c24-8a70-1c1cad06f4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78bc75c-02f0-4050-94ed-ef6fe33fdae0', 'volume_name': 'volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87633c55-9c00-4f69-92c0-e6640b355d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87633c55-9c00-4f69-92c0-e6640b355d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c21fa5a-b247-4ece-88d9-958d7a6f6db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:49 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume b78bc75c-02f0-4050-94ed-ef6fe33fdae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0', 'volume_size': 1} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-94d6ffec-8e4b-4194-bf70-35ef0f7e747f" released by "delete_volume" :: held 2.150s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Created reservations ['536c1934-2bb3-4304-9ed1-d565cac72050', '017da155-9b5c-4efc-b024-fec51828f440', 'cf7e9597-ec24-4cee-9a6b-0011108a9e7e', 'afac5668-9239-4b05-837d-91de36ed3962'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:49 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:49 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:49 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:50 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221" returned: 0 in 0.589s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:50 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 is being set with open permissions: ugo+rw Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:50 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 Apr 13 17:50:50 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:50 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.559s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:50 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Deleted volume successfully. Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4bcc5606-8e15-4a6d-a8c4-ff89125fbc2b tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-94d6ffec-8e4b-4194-bf70-35ef0f7e747f-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:50 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221" returned: 0 in 0.470s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:50 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.info Apr 13 17:50:50 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Flow 'volume_create_manager' (5f37882a-71b4-4ea2-9b23-ecc0330d1079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da77c836-c301-4e6a-ab8f-c11a70ae8303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da77c836-c301-4e6a-ab8f-c11a70ae8303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1417569285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa324a67-4c7a-4e09-9a33-3291efee74f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5b48615e1544e8827292f897a49f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:51Z,use_quota=True,user_id='f61a325ca675440ca2b8fddc045a5944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6a1237-0ef1-4967-9f42-a07d9b72585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6a1237-0ef1-4967-9f42-a07d9b72585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa8b031-7f7f-4416-aac3-43ea15d76afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa8b031-7f7f-4416-aac3-43ea15d76afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa324a67-4c7a-4e09-9a33-3291efee74f3', 'volume_name': 'volume-aa324a67-4c7a-4e09-9a33-3291efee74f3', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc8eef2-48ec-4c0d-a1d3-1859a4a3c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc8eef2-48ec-4c0d-a1d3-1859a4a3c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93d7b3a-e106-48ea-9846-4d070c7ebbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:50 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Volume aa324a67-4c7a-4e09-9a33-3291efee74f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa324a67-4c7a-4e09-9a33-3291efee74f3', 'volume_size': 1} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-4edda15e-df9c-4aff-a16d-3ce48b45ad83-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-4edda15e-df9c-4aff-a16d-3ce48b45ad83-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-quobyte-4edda15e-df9c-4aff-a16d-3ce48b45ad83" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-4edda15e-df9c-4aff-a16d-3ce48b45ad83" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[108cff7d-9a55-4912-bd66-531d87578aa0]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:50 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 Apr 13 17:50:50 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:50 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.info" returned: 0 in 0.454s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:50 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.info is being set with open permissions: ugo+rw Apr 13 17:50:50 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:50 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.info Apr 13 17:50:50 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:51 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83" returned: 0 in 0.479s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:51 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83 Apr 13 17:50:51 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:51 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.info" returned: 0 in 0.406s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.656s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.033s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490110452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0181c3-9187-4703-9ccc-a0e4db5b8f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:48Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Creating volume 7b0181c3-9187-4703-9ccc-a0e4db5b8f77 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:51 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:51 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 1073741824 Apr 13 17:50:51 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:51 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-8e5647e4-c986-46bc-9748-f004df0bf44c tempest-VolumeDependencyTests-2020647289 None] Create snapshot completed successfully Apr 13 17:50:51 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4edda15e-df9c-4aff-a16d-3ce48b45ad83" returned: 0 in 0.435s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-4edda15e-df9c-4aff-a16d-3ce48b45ad83" released by "delete_volume" :: held 0.936s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Created reservations ['ba3efaf7-ec24-4a41-acf2-0844a1a4a98f', '2c3af053-e009-478e-b740-a0c47b3cb986', '6c3a3eb0-736d-43a0-99b2-a084cb3488cd', 'df040616-d4e1-4eed-a264-bb6d33aa91b6'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:51 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:51 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-cf76dfaf-3106-43f7-b324-98c4fc273eb0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-cf76dfaf-3106-43f7-b324-98c4fc273eb0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-quobyte-cf76dfaf-3106-43f7-b324-98c4fc273eb0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-cf76dfaf-3106-43f7-b324-98c4fc273eb0" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c6fac9-9358-47ef-8819-e271baa45468]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:51 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 Apr 13 17:50:51 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:51 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 1073741824" returned: 0 in 0.535s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:51 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:51 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 Apr 13 17:50:51 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:52 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.455s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:52 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Deleted volume successfully. Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-4a5ad702-37c0-4e42-9a3b-4edf61ae55ac tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-4edda15e-df9c-4aff-a16d-3ce48b45ad83-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:52 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0" returned: 0 in 0.534s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:52 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0 Apr 13 17:50:52 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:52 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77" returned: 0 in 0.439s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.758s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132285727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d42f44f-3d1c-48a9-a404-1be70e178993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:48Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Creating volume 7d42f44f-3d1c-48a9-a404-1be70e178993 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:52 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:52 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 1073741824 Apr 13 17:50:52 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cbb2cc-d993-40b9-8a7a-34d8193fdd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269e47a9-6372-4e46-870b-99e1ddc941aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:52 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 (7b0181c3-9187-4703-9ccc-a0e4db5b8f77): created successfully Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269e47a9-6372-4e46-870b-99e1ddc941aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (d32b1660-e9a0-433c-b609-6d43b54fd942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:52 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ca5bbec4-be25-4333-83d7-4afb9bf035ae tempest-CreateVolumesFromSnapshotTest-859567379 None] Created volume successfully. Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Flow 'volume_create_manager' (e541f36a-f798-4ce1-8584-16ef72f0c712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ede3891-3885-45c7-b2ed-9a0f32da8b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ede3891-3885-45c7-b2ed-9a0f32da8b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1039866255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1bc454-74a2-43ff-ae52-ca43710782a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e006dde5b6b4d76a98da60b351b6d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5135e4e9-da54-4d67-936b-6588e2177221,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:52Z,use_quota=True,user_id='5e3e16ca8d594b1bb513464d40b178b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127029c4-bbbc-46cf-b98f-3480da68b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127029c4-bbbc-46cf-b98f-3480da68b635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b501f8c-b546-4557-ab1a-4f8d100ba139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b501f8c-b546-4557-ab1a-4f8d100ba139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a1bc454-74a2-43ff-ae52-ca43710782a9', 'volume_name': 'volume-7a1bc454-74a2-43ff-ae52-ca43710782a9', 'volume_size': 1, 'snapshot_id': '5135e4e9-da54-4d67-936b-6588e2177221'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16afad7-f334-4179-9785-53f0e6c6d228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16afad7-f334-4179-9785-53f0e6c6d228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875baa2a-97ab-459d-9276-c62a6974f141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:52 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Volume 7a1bc454-74a2-43ff-ae52-ca43710782a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a1bc454-74a2-43ff-ae52-ca43710782a9', 'volume_size': 1, 'snapshot_id': '5135e4e9-da54-4d67-936b-6588e2177221'} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:52 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-cf76dfaf-3106-43f7-b324-98c4fc273eb0" returned: 0 in 0.405s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-cf76dfaf-3106-43f7-b324-98c4fc273eb0" released by "delete_volume" :: held 0.961s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Created reservations ['6a4ed856-535c-403f-ab3b-845cddd9a5b0', '46958991-7393-4a1a-97f9-897b654730e7', 'cb7191de-2db3-4302-9296-3f98e940bddc', 'a5b66f7c-28e0-4ff5-b880-96675830f292'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:52 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:52 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-f8de46c5-e971-47a2-8aef-86f4374d51cc-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-f8de46c5-e971-47a2-8aef-86f4374d51cc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "cinder-quobyte-f8de46c5-e971-47a2-8aef-86f4374d51cc" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-f8de46c5-e971-47a2-8aef-86f4374d51cc" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f2be13-9df5-49fb-b64c-fe5b16c21abc]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:52 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:52 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 1073741824" returned: 0 in 0.604s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:53 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc Apr 13 17:50:53 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:53 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 Apr 13 17:50:53 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:53 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.441s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:53 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Deleted volume successfully. Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d2694dbb-f811-4731-adb8-60791aac782c tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-cf76dfaf-3106-43f7-b324-98c4fc273eb0-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:53 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993" returned: 0 in 0.409s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:53 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.581s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141038975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c662ce-efdd-4399-8eff-73de936457eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:49Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Creating volume a5c662ce-efdd-4399-8eff-73de936457eb {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:53 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ae238a-5e0b-400d-b9ac-acb5930c45c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d42f44f-3d1c-48a9-a404-1be70e178993', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefac549-0c7d-4e02-af72-070ebe7c2f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:53 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb 1073741824 Apr 13 17:50:53 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc" returned: 0 in 0.538s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:53 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume volume-7d42f44f-3d1c-48a9-a404-1be70e178993 (7d42f44f-3d1c-48a9-a404-1be70e178993): created successfully Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefac549-0c7d-4e02-af72-070ebe7c2f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:53 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (bddebf7e-46db-46c3-bd8b-5d10c5990150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:53 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc Apr 13 17:50:53 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:53 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c58a2582-8673-4239-9247-8cebb7fd202e tempest-CreateVolumesFromSnapshotTest-859567379 None] Created volume successfully. Apr 13 17:50:54 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f8de46c5-e971-47a2-8aef-86f4374d51cc" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-quobyte-f8de46c5-e971-47a2-8aef-86f4374d51cc" released by "delete_volume" :: held 1.095s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Created reservations ['ce0b400a-120f-48f6-adbf-9696c0c235a5', 'd6ce120e-4670-4c79-8feb-a812e28c840b', 'c33b8fd6-038c-4ae5-b4cf-b37517762e02', '7de61f27-c826-4c4b-bef3-79504a6892f1'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:54 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb 1073741824" returned: 0 in 0.652s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:54 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:54 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:54 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb Apr 13 17:50:54 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:54 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.468s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:54 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Deleted volume successfully. Apr 13 17:50:54 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb" returned: 0 in 0.452s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a4b1b865-a7ab-4786-8b4f-c35425be3372 tempest-CreateVolumesFromImageTest-655271679 None] Lock "cinder-f8de46c5-e971-47a2-8aef-86f4374d51cc-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.372s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-687761718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a3c2d2-e7a0-4ed5-b513-787f58c892ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:49Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Creating volume 93a3c2d2-e7a0-4ed5-b513-787f58c892ca {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:54 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e409812-df2b-438d-b0f7-5fc249e893eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c662ce-efdd-4399-8eff-73de936457eb', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062d4853-66ad-4300-80ca-2a8d6555690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:54 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca 1073741824 Apr 13 17:50:54 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:54 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume volume-a5c662ce-efdd-4399-8eff-73de936457eb (a5c662ce-efdd-4399-8eff-73de936457eb): created successfully Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062d4853-66ad-4300-80ca-2a8d6555690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:54 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (74401d6b-2442-40e1-b8fa-77ec33be0285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:54 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-bd3e95db-dd54-434c-bf3e-954d9f35fd8d tempest-CreateVolumesFromSnapshotTest-859567379 None] Created volume successfully. Apr 13 17:50:55 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca 1073741824" returned: 0 in 0.495s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:55 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca Apr 13 17:50:55 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:55 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca" returned: 0 in 0.472s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.046s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1093132142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78bc75c-02f0-4050-94ed-ef6fe33fdae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f09258efd1e4a80b49049c9d4c10a2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:49Z,use_quota=True,user_id='c1160ba95478430fb39f9bbbcffbe8a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Creating volume b78bc75c-02f0-4050-94ed-ef6fe33fdae0 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:55 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7b9efc-ff70-4294-b332-5489fbd47016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5a4538-fb64-4e6e-b7c4-7d21bc82a65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:55 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 1073741824 Apr 13 17:50:55 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:55 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca (93a3c2d2-e7a0-4ed5-b513-787f58c892ca): created successfully Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5a4538-fb64-4e6e-b7c4-7d21bc82a65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:55 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (ee90baaf-dce8-4e8c-8927-f8ea289620e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:55 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2cacee72-45e6-4d77-8ff9-bc8059f5f916 tempest-CreateVolumesFromSnapshotTest-859567379 None] Created volume successfully. Apr 13 17:50:56 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 1073741824" returned: 0 in 0.529s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:56 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 Apr 13 17:50:56 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:56 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0" returned: 0 in 0.463s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.979s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1417569285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa324a67-4c7a-4e09-9a33-3291efee74f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5b48615e1544e8827292f897a49f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:51Z,use_quota=True,user_id='f61a325ca675440ca2b8fddc045a5944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Creating volume aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:56 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c21fa5a-b247-4ece-88d9-958d7a6f6db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:56 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 1073741824 Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23a989d-b7d8-4334-88a3-25669dbf60cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:56 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:56 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Volume volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 (b78bc75c-02f0-4050-94ed-ef6fe33fdae0): created successfully Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23a989d-b7d8-4334-88a3-25669dbf60cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Flow 'volume_create_manager' (d70ab627-633f-418c-9c3c-df798c8d45ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:56 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-9dc7b190-f10f-4661-b9f6-0c3d270be919 tempest-CreateVolumesFromSnapshotTest-859567379 None] Created volume successfully. Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (16af392f-4ee0-4b94-888d-4c4dbb0123d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47da1e0a-acbd-4018-8863-b7f37027b35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47da1e0a-acbd-4018-8863-b7f37027b35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-171448241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c29f1c-b411-4a6c-9de3-bfc1b1f1106a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:57Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48abd79c-a939-4d8b-ac39-22a7106ce466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48abd79c-a939-4d8b-ac39-22a7106ce466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ce96c8-c7d2-41cd-970d-312ce882bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ce96c8-c7d2-41cd-970d-312ce882bf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c29f1c-b411-4a6c-9de3-bfc1b1f1106a', 'volume_name': 'volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c1830c-e699-4bfa-b7f2-5945a5079396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c1830c-e699-4bfa-b7f2-5945a5079396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db911b7d-65c6-497e-88bd-9e9773930de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:56 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume 08c29f1c-b411-4a6c-9de3-bfc1b1f1106a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a', 'volume_size': 1} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:56 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-b78bc75c-02f0-4050-94ed-ef6fe33fdae0-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-b78bc75c-02f0-4050-94ed-ef6fe33fdae0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-quobyte-b78bc75c-02f0-4050-94ed-ef6fe33fdae0" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-b78bc75c-02f0-4050-94ed-ef6fe33fdae0" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[92116822-7c04-4630-a274-90a321f26839]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:57 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 Apr 13 17:50:57 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:57 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 1073741824" returned: 0 in 0.551s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:57 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 Apr 13 17:50:57 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:57 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0" returned: 0 in 0.487s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:57 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0 Apr 13 17:50:57 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:57 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3" returned: 0 in 0.421s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.070s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-5135e4e9-da54-4d67-936b-6588e2177221-7a1bc454-74a2-43ff-ae52-ca43710782a9" by "_create_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93d7b3a-e106-48ea-9846-4d070c7ebbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa324a67-4c7a-4e09-9a33-3291efee74f3', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2421640-32e4-452d-a16b-5d693bc5e7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-5135e4e9-da54-4d67-936b-6588e2177221-7a1bc454-74a2-43ff-ae52-ca43710782a9" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Creating volume 7a1bc454-74a2-43ff-ae52-ca43710782a9 from snapshot 5135e4e9-da54-4d67-936b-6588e2177221 {{(pid=82736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-7a1bc454-74a2-43ff-ae52-ca43710782a9" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:57 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Volume volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 (aa324a67-4c7a-4e09-9a33-3291efee74f3): created successfully Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2421640-32e4-452d-a16b-5d693bc5e7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Flow 'volume_create_manager' (5f37882a-71b4-4ea2-9b23-ecc0330d1079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-7a1bc454-74a2-43ff-ae52-ca43710782a9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] snapshot: 5135e4e9-da54-4d67-936b-6588e2177221, volume: 7a1bc454-74a2-43ff-ae52-ca43710782a9, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:50:57 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-72b1bde6-8228-4c84-9a28-561353067abc tempest-SnapshotDependencyTests-1174190304 None] Created volume successfully. Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[995e4e30-1f98-4b30-a87f-b6fc3b3f8f1a]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:57 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:57 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 Apr 13 17:50:57 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:58 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-b78bc75c-02f0-4050-94ed-ef6fe33fdae0" returned: 0 in 0.464s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-b78bc75c-02f0-4050-94ed-ef6fe33fdae0" released by "delete_volume" :: held 0.977s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Created reservations ['6403b5ad-1230-437a-85e3-0f8942c74569', 'ecfd3aba-ffc2-4697-9ac4-9c92911c13ae', 'edb092cf-0643-4631-87db-6897554c475c', '4ceaf3ce-b846-4e3a-b325-8ad2334da7fa'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:58 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:50:58 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:50:58 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221" returned: 0 in 0.549s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d632933-3a05-4957-9745-5c8a80e0c5d1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:58 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c Apr 13 17:50:58 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:58 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.422s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:50:58 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Deleted volume successfully. Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-0248dcfc-244e-4717-be9a-eba834752e4c tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-b78bc75c-02f0-4050-94ed-ef6fe33fdae0-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:50:58 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c" returned: 0 in 0.490s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:50:58 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:58 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 Apr 13 17:50:58 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:50:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-93a3c2d2-e7a0-4ed5-b513-787f58c892ca-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-93a3c2d2-e7a0-4ed5-b513-787f58c892ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-quobyte-93a3c2d2-e7a0-4ed5-b513-787f58c892ca" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:50:59 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-93a3c2d2-e7a0-4ed5-b513-787f58c892ca" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:50:59 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c26a4da-9b2b-4b7d-8770-57221196e1ae]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:50:59 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:50:59 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca Apr 13 17:50:59 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:00 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9" returned: 0 in 2.088s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:00 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5097b8aa-f96f-49e0-b3c4-de826fda9b99]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:00 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca" returned: 0 in 1.616s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:00 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:00 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca Apr 13 17:51:00 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:00 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c Apr 13 17:51:00 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:01 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-93a3c2d2-e7a0-4ed5-b513-787f58c892ca" returned: 0 in 0.409s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-93a3c2d2-e7a0-4ed5-b513-787f58c892ca" released by "delete_volume" :: held 2.069s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Created reservations ['1d624101-62e6-42c0-b29e-d391be1a29ca', '9c3091f6-f4be-4876-98bd-c2ece0dc5a2a', '7d707112-8d2b-4391-b142-9e948063ce81', '96bebd67-a072-444f-9231-f8da3ae7bff9'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:01 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:01 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-a5c662ce-efdd-4399-8eff-73de936457eb-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-a5c662ce-efdd-4399-8eff-73de936457eb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-quobyte-a5c662ce-efdd-4399-8eff-73de936457eb" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-a5c662ce-efdd-4399-8eff-73de936457eb" acquired by "delete_volume" :: waited 0.018s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d538317-7dc5-4ff1-b79c-719994c121a3]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:01 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c" returned: 0 in 0.652s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:51:01 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Converted 1024.00 MB image at 490.10 MB/s Apr 13 17:51:01 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 is being set with open permissions: ugo+rw Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:01 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 Apr 13 17:51:01 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:01 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb Apr 13 17:51:01 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:01 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.433s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:01 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Deleted volume successfully. Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-016da6ff-ef4f-4d1c-b8d2-f675a61035f5 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-93a3c2d2-e7a0-4ed5-b513-787f58c892ca-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:01 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:01 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9" returned: 0 in 0.430s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-7a1bc454-74a2-43ff-ae52-ca43710782a9" released by "_copy_volume_from_snapshot" :: held 4.285s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-5135e4e9-da54-4d67-936b-6588e2177221-7a1bc454-74a2-43ff-ae52-ca43710782a9" released by "_create_volume_from_snapshot" :: held 4.317s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:01 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.345s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:01 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.108s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-171448241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c29f1c-b411-4a6c-9de3-bfc1b1f1106a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:50:57Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Creating volume 08c29f1c-b411-4a6c-9de3-bfc1b1f1106a {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:01 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:01 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:02 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a 1073741824 Apr 13 17:51:02 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875baa2a-97ab-459d-9276-c62a6974f141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1bc454-74a2-43ff-ae52-ca43710782a9', 'volume_size': 1, 'snapshot_id': '5135e4e9-da54-4d67-936b-6588e2177221'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34eddcbd-5a22-4f48-b592-31712ab7816b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:02 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Volume volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 (7a1bc454-74a2-43ff-ae52-ca43710782a9): created successfully Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34eddcbd-5a22-4f48-b592-31712ab7816b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Flow 'volume_create_manager' (e541f36a-f798-4ce1-8584-16ef72f0c712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:02 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-abfa446b-7181-4d5d-a57e-1ac0b615571b tempest-VolumeDependencyTests-2020647289 None] Created volume successfully. Apr 13 17:51:02 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a5c662ce-efdd-4399-8eff-73de936457eb" returned: 0 in 0.442s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-a5c662ce-efdd-4399-8eff-73de936457eb" released by "delete_volume" :: held 0.919s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Created reservations ['434ffee0-3382-41cf-8be5-84606815d486', '6f04697f-f741-4063-a6a5-9c9d66f2bf70', 'c86c2377-1721-4783-8edc-1983048a9268', 'a14f3684-1130-41e8-b1b4-52443dfaee9d'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:02 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:02 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-7d42f44f-3d1c-48a9-a404-1be70e178993-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-7d42f44f-3d1c-48a9-a404-1be70e178993-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:02 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a 1073741824" returned: 0 in 0.627s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-quobyte-7d42f44f-3d1c-48a9-a404-1be70e178993" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:02 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a Apr 13 17:51:02 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-7d42f44f-3d1c-48a9-a404-1be70e178993" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[d767cf18-43b2-480e-b4c2-5057a811eaca]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:02 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 Apr 13 17:51:02 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:02 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.425s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:02 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Deleted volume successfully. Apr 13 17:51:02 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-d4071593-de85-4773-95f9-29db7399db69 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-a5c662ce-efdd-4399-8eff-73de936457eb-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:03 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a" returned: 0 in 0.450s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.920s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db911b7d-65c6-497e-88bd-9e9773930de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efb0c1e-4264-43be-93b3-2af536f20cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-5135e4e9-da54-4d67-936b-6588e2177221-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Creating offline snapshot 05fd63d8-5c93-4975-b922-a6c711718dc2 of volume aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:51:03 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a (08c29f1c-b411-4a6c-9de3-bfc1b1f1106a): created successfully Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efb0c1e-4264-43be-93b3-2af536f20cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (16af392f-4ee0-4b94-888d-4c4dbb0123d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-5135e4e9-da54-4d67-936b-6588e2177221-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-2abc957e-78b0-4a96-a936-ab637cfc7f4c" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d590a7-4c3d-4a72-8add-9c8d83342b3c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:03 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:03 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-df469e06-6334-4466-ad89-63a03e8d2d1f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created volume successfully. Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993" returned: 0 in 0.506s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-2abc957e-78b0-4a96-a936-ab637cfc7f4c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-5135e4e9-da54-4d67-936b-6588e2177221" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:03 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993 Apr 13 17:51:03 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-5135e4e9-da54-4d67-936b-6588e2177221" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Deleting offline snapshot 5135e4e9-da54-4d67-936b-6588e2177221 of volume 2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] snapshot_file for this snap is: volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e20104-589b-4549-8267-5b9c3f5f8c8d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:03 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 Apr 13 17:51:03 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:03 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 Apr 13 17:51:03 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:03 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7d42f44f-3d1c-48a9-a404-1be70e178993" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-7d42f44f-3d1c-48a9-a404-1be70e178993" released by "delete_volume" :: held 0.983s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Created reservations ['6a758286-1c66-4cb9-9ad3-937f9bece80d', '6910e05b-9921-4b43-a32f-0cd78156fa7a', 'e01baf2c-17bd-4d8f-9ea4-f6e2c8a56ea3', 'f266dd19-10d9-44d2-996a-7bcbc305f01a'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:03 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3" returned: 0 in 0.567s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:03 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221" returned: 0 in 0.524s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:51:03 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 1G Apr 13 17:51:03 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28c1106-515f-4a42-978e-e695241f42d5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:03 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:03 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:03 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:03 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c Apr 13 17:51:03 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:04 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 1G" returned: 0 in 0.532s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:04 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 Apr 13 17:51:04 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:04 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:04 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Deleted volume successfully. Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2e339d0c-89af-4e21-bca3-ab08256b66e7 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-7d42f44f-3d1c-48a9-a404-1be70e178993-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:04 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c" returned: 0 in 0.570s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:04 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 Apr 13 17:51:04 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (477f8237-f576-49c8-b7b3-cf9e9e578433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b73f401-b9bd-45ad-8abf-974b249f5957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b73f401-b9bd-45ad-8abf-974b249f5957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407870400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eac478b-2bb6-42e3-9124-03e87bab4d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:05Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f978e5e7-e78f-4af1-adf6-359851bffde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f978e5e7-e78f-4af1-adf6-359851bffde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67821f61-7870-4ce2-bb44-e7b5607a3068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67821f61-7870-4ce2-bb44-e7b5607a3068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eac478b-2bb6-42e3-9124-03e87bab4d4b', 'volume_name': 'volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cb6d67-1c36-4e59-8ab7-fa57fe3baa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cb6d67-1c36-4e59-8ab7-fa57fe3baa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c154e4a-65cd-4159-b8b8-e2fc089b5e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume 7eac478b-2bb6-42e3-9124-03e87bab4d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b', 'volume_size': 1} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-7b0181c3-9187-4703-9ccc-a0e4db5b8f77-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:04 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2" returned: 0 in 0.545s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:04 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 is being set with open permissions: ugo+rw Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-7b0181c3-9187-4703-9ccc-a0e4db5b8f77-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:04 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 Apr 13 17:51:04 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-quobyte-7b0181c3-9187-4703-9ccc-a0e4db5b8f77" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (c123a858-a26f-44c5-9b77-754729b42398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b346bc77-2d23-4923-8ea6-ed28befa608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b346bc77-2d23-4923-8ea6-ed28befa608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288564128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:05Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74126144-a24f-4b02-bc4b-cb004d0f607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74126144-a24f-4b02-bc4b-cb004d0f607b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16acc456-ea11-469a-81da-e040166edf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16acc456-ea11-469a-81da-e040166edf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78', 'volume_name': 'volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00c39d3-434d-4c89-bbc7-8b3a0aa63c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00c39d3-434d-4c89-bbc7-8b3a0aa63c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de26b62-20ed-4b1d-b892-68330f8fe254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:04 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume 5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78', 'volume_size': 1} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-7b0181c3-9187-4703-9ccc-a0e4db5b8f77" acquired by "delete_volume" :: waited 0.072s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:04 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221" returned: 0 in 0.624s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ac348-151a-4c4a-baad-3882716f11f8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:04 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:04 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221 Apr 13 17:51:04 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:05 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 Apr 13 17:51:05 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (5b028c39-8db6-4f4b-94f1-9cc259f988cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae078c1a-e135-4447-a7c6-f0a4f50ce1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae078c1a-e135-4447-a7c6-f0a4f50ce1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185497241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc40ba1-b8ef-4bc1-aef6-a458d867a527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:05Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c179cb1-fd0d-434a-9d36-4004528faad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c179cb1-fd0d-434a-9d36-4004528faad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e58fe7-64de-44bc-a163-8ca570035b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e58fe7-64de-44bc-a163-8ca570035b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc40ba1-b8ef-4bc1-aef6-a458d867a527', 'volume_name': 'volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9811a4cc-0432-4697-a6ff-870d4940abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9811a4cc-0432-4697-a6ff-870d4940abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0229d6-2d66-48dd-b0fb-5b90234a13f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume 1fc40ba1-b8ef-4bc1-aef6-a458d867a527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527', 'volume_size': 1} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:05 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (362881ae-1148-4efe-8019-28f3264dc6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2dcf2f-3b4c-4a27-959b-e97e08532a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2" returned: 0 in 0.583s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2dcf2f-3b4c-4a27-959b-e97e08532a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046210348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46512fcf-9357-4f14-b604-5c821375bb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:05Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af780ddf-f113-4d48-84b1-9060f3eccee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af780ddf-f113-4d48-84b1-9060f3eccee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ab3990-2f5e-4e36-9b6e-744a43723300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ab3990-2f5e-4e36-9b6e-744a43723300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46512fcf-9357-4f14-b604-5c821375bb8b', 'volume_name': 'volume-46512fcf-9357-4f14-b604-5c821375bb8b', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1af92e6-0888-43ae-85da-1451515fba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1af92e6-0888-43ae-85da-1451515fba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65043e3-45d3-4ff8-adf7-f25454e4fc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume 46512fcf-9357-4f14-b604-5c821375bb8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46512fcf-9357-4f14-b604-5c821375bb8b', 'volume_size': 1} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:05 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.info Apr 13 17:51:05 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:05 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c.5135e4e9-da54-4d67-936b-6588e2177221" returned: 0 in 0.575s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-5135e4e9-da54-4d67-936b-6588e2177221" released by "_delete_snapshot" :: held 2.367s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-2abc957e-78b0-4a96-a936-ab637cfc7f4c" released by "delete_snapshot" :: held 2.381s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Created reservations ['985b88bc-9169-4a1a-b449-bdbcca6c1e60', 'c870777e-38ed-44f0-80a0-d1d20d1d5cc2', 'fb0f94a4-b746-4cca-a169-b37e545add3e', 'c3eec52f-2ead-47c1-8538-dbe9e028ed04'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (6c62f909-c10a-4d52-9d39-f52814582416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:05 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdbe88b-e750-4d09-b40c-dc9dcdc661e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77" returned: 0 in 0.694s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:05 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77 Apr 13 17:51:05 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdbe88b-e750-4d09-b40c-dc9dcdc661e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288048245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31ab9fd-75df-42b0-a780-33fe7d60c054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:06Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfbb1a8-e722-4fd1-81bd-0a67bc363721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfbb1a8-e722-4fd1-81bd-0a67bc363721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acac44a-ad52-47b3-8efc-bfb66028b4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acac44a-ad52-47b3-8efc-bfb66028b4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31ab9fd-75df-42b0-a780-33fe7d60c054', 'volume_name': 'volume-a31ab9fd-75df-42b0-a780-33fe7d60c054', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe17912a-e305-425c-ab15-8789ce3aec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe17912a-e305-425c-ab15-8789ce3aec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445e8363-7137-4248-b973-ca60ad653301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:05 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume a31ab9fd-75df-42b0-a780-33fe7d60c054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31ab9fd-75df-42b0-a780-33fe7d60c054', 'volume_size': 1} Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:05 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Delete snapshot completed successfully. Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-32191612-bcb8-400f-864c-3bb616c71f58 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-5135e4e9-da54-4d67-936b-6588e2177221-delete_snapshot" released by "delete_snapshot" :: held 2.590s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:05 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.info" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:05 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.info is being set with open permissions: ugo+rw Apr 13 17:51:05 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:05 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.info Apr 13 17:51:05 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:06 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7b0181c3-9187-4703-9ccc-a0e4db5b8f77" returned: 0 in 0.406s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-7b0181c3-9187-4703-9ccc-a0e4db5b8f77" released by "delete_volume" :: held 1.138s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Created reservations ['2d4e447b-9c07-4f8a-a034-262f1402d5a7', 'f6f83217-4b29-470e-921d-2eb8e11847e8', '3f360e10-1df1-4900-9f5e-ad398ee09a49', '80a456f2-9575-48e4-b6f2-6f3f7ab8c73d'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:06 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:06 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-2abc957e-78b0-4a96-a936-ab637cfc7f4c-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-2abc957e-78b0-4a96-a936-ab637cfc7f4c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-2abc957e-78b0-4a96-a936-ab637cfc7f4c" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-2abc957e-78b0-4a96-a936-ab637cfc7f4c" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb1db5a-d866-410f-a33e-36969f5d56da]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:06 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.info" returned: 0 in 0.492s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:06 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c Apr 13 17:51:06 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.360s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.816s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407870400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eac478b-2bb6-42e3-9124-03e87bab4d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:05Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Creating volume 7eac478b-2bb6-42e3-9124-03e87bab4d4b {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:06 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:06 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e856c86f-7b90-48ae-8e6d-7d0aa84e7713 tempest-SnapshotDependencyTests-1174190304 None] Create snapshot completed successfully Apr 13 17:51:06 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b 1073741824 Apr 13 17:51:06 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:06 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.464s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:06 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Deleted volume successfully. Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-a90a29c3-9df4-4e45-a3c5-be24276cbc67 tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-7b0181c3-9187-4703-9ccc-a0e4db5b8f77-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:06 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c" returned: 0 in 0.528s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:06 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c Apr 13 17:51:06 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-320e3d96-9a28-41e8-941e-9fd8bbcff89a-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-320e3d96-9a28-41e8-941e-9fd8bbcff89a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-quobyte-c9d1de8e-7005-43f6-a647-3677941f8511" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-c9d1de8e-7005-43f6-a647-3677941f8511" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:06 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-quobyte-320e3d96-9a28-41e8-941e-9fd8bbcff89a" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-320e3d96-9a28-41e8-941e-9fd8bbcff89a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Deleting offline snapshot 320e3d96-9a28-41e8-941e-9fd8bbcff89a of volume c9d1de8e-7005-43f6-a647-3677941f8511 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] snapshot_file for this snap is: volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e78dc6-a74d-451e-9cfa-45ed0e612b46]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:07 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b 1073741824" returned: 0 in 0.544s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:07 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b Apr 13 17:51:07 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:07 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a Apr 13 17:51:07 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:07 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-2abc957e-78b0-4a96-a936-ab637cfc7f4c" returned: 0 in 0.431s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-2abc957e-78b0-4a96-a936-ab637cfc7f4c" released by "delete_volume" :: held 0.997s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Created reservations ['28731ba3-2cfe-46af-b4ab-d9b944b6b83a', '0e7ecd78-250a-4753-8048-133a39ace2c4', '87ca0589-274c-4925-81bc-869dc4fb7e76', 'e9432170-a6f8-46f4-8e1b-acd19cd291ce'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:07 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:07 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:07 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b" returned: 0 in 0.456s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288564128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:05Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Creating volume 5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:07 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c154e4a-65cd-4159-b8b8-e2fc089b5e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0a195a-330c-4055-9bc6-854495a4321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:07 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:07 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 1073741824 Apr 13 17:51:07 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a" returned: 0 in 0.548s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d1de8e-7005-43f6-a647-3677941f8511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:51:07 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b (7eac478b-2bb6-42e3-9124-03e87bab4d4b): created successfully Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0a195a-330c-4055-9bc6-854495a4321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (477f8237-f576-49c8-b7b3-cf9e9e578433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c6f303-0944-42d0-a786-94078011f760]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a2d6ca54-d185-4dcf-8eb8-b50868ce0262 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created volume successfully. Apr 13 17:51:07 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 Apr 13 17:51:07 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Flow 'volume_create_manager' (8f50fd77-70c0-4b5c-8cd5-deb2fc28d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d411778-ace5-42b0-bc3e-ed9ee179d313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d411778-ace5-42b0-bc3e-ed9ee179d313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b53303-defd-445e-ab65-d7e3754ed058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5b48615e1544e8827292f897a49f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05fd63d8-5c93-4975-b922-a6c711718dc2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:08Z,use_quota=True,user_id='f61a325ca675440ca2b8fddc045a5944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a21d75-5c54-4dee-a422-b344be9c49c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a21d75-5c54-4dee-a422-b344be9c49c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2673d7-cb07-49c9-9928-f906f950ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2673d7-cb07-49c9-9928-f906f950ba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9b53303-defd-445e-ab65-d7e3754ed058', 'volume_name': 'volume-a9b53303-defd-445e-ab65-d7e3754ed058', 'volume_size': 1, 'snapshot_id': '05fd63d8-5c93-4975-b922-a6c711718dc2'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:07 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e459fa1-cf3e-425f-bbe9-8c55e60f4ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e459fa1-cf3e-425f-bbe9-8c55e60f4ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6956103e-29fb-42ef-86fe-df7354e2def0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:07 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Volume a9b53303-defd-445e-ab65-d7e3754ed058: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9b53303-defd-445e-ab65-d7e3754ed058', 'volume_size': 1, 'snapshot_id': '05fd63d8-5c93-4975-b922-a6c711718dc2'} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.522s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:07 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Deleted volume successfully. Apr 13 17:51:07 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2256a2aa-a032-4470-aa03-4dc0b2e90f9f tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-2abc957e-78b0-4a96-a936-ab637cfc7f4c-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:08 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 1073741824" returned: 0 in 0.617s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:08 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511" returned: 0 in 0.575s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:08 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 Apr 13 17:51:08 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:08 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a Apr 13 17:51:08 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:08 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78" returned: 0 in 0.432s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.395s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185497241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc40ba1-b8ef-4bc1-aef6-a458d867a527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:05Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Creating volume 1fc40ba1-b8ef-4bc1-aef6-a458d867a527 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:08 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de26b62-20ed-4b1d-b892-68330f8fe254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622f66e0-2015-4524-888c-eb3a3931ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:08 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 1073741824 Apr 13 17:51:08 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:08 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a" returned: 0 in 0.469s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:08 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 (5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78): created successfully Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622f66e0-2015-4524-888c-eb3a3931ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (c123a858-a26f-44c5-9b77-754729b42398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:08 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-0fce6cc8-8c57-45cc-929f-ff74137d7c50 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created volume successfully. Apr 13 17:51:08 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a Apr 13 17:51:08 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Flow 'volume_create_manager' (e8b3cbee-dc10-4468-85fa-184b5aba165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad41c23-2aeb-4bbb-93ce-38619537eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad41c23-2aeb-4bbb-93ce-38619537eb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1566204436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e006dde5b6b4d76a98da60b351b6d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:09Z,use_quota=True,user_id='5e3e16ca8d594b1bb513464d40b178b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f3b9b7-4117-49f2-9449-6552f355191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f3b9b7-4117-49f2-9449-6552f355191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0078a423-2110-4b63-a4ab-8a5e3cb4d096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0078a423-2110-4b63-a4ab-8a5e3cb4d096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff', 'volume_name': 'volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76606d36-c6b7-4196-899b-14728ed14434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76606d36-c6b7-4196-899b-14728ed14434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223b0a9f-ab65-4064-ae35-2a481e320e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:08 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Volume 4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff', 'volume_size': 1} Apr 13 17:51:08 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:09 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511.320e3d96-9a28-41e8-941e-9fd8bbcff89a" returned: 0 in 0.467s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-320e3d96-9a28-41e8-941e-9fd8bbcff89a" released by "_delete_snapshot" :: held 2.122s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-c9d1de8e-7005-43f6-a647-3677941f8511" released by "delete_snapshot" :: held 2.134s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:09 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 1073741824" returned: 0 in 0.560s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Created reservations ['c7622d40-ee52-42fd-a28b-96c526f21a18', '0c0f0cce-e805-41cb-baed-9aac8673c4c5', '2a4d0905-9eb1-44ba-8385-6e9d9409c79c', '5c85eab0-a04e-4c1e-b772-cff2b2fe3200'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:09 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 Apr 13 17:51:09 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:09 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Delete snapshot completed successfully. Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e8043bee-5f87-4908-8227-c102ec9deada tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-320e3d96-9a28-41e8-941e-9fd8bbcff89a-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:09 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527" returned: 0 in 0.412s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.168s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046210348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46512fcf-9357-4f14-b604-5c821375bb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:05Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Creating volume 46512fcf-9357-4f14-b604-5c821375bb8b {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:09 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0229d6-2d66-48dd-b0fb-5b90234a13f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed1211a-0097-4cbc-beb5-dc42240e6856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:09 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b 1073741824 Apr 13 17:51:09 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:09 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 (1fc40ba1-b8ef-4bc1-aef6-a458d867a527): created successfully Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed1211a-0097-4cbc-beb5-dc42240e6856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (5b028c39-8db6-4f4b-94f1-9cc259f988cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:09 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5a19d532-8619-4880-ba02-41f5fc4aa387 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created volume successfully. Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_service.periodic_task [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82736) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:09 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:09 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:09 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-c9d1de8e-7005-43f6-a647-3677941f8511-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-c9d1de8e-7005-43f6-a647-3677941f8511-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "cinder-quobyte-c9d1de8e-7005-43f6-a647-3677941f8511" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-c9d1de8e-7005-43f6-a647-3677941f8511" acquired by "delete_volume" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:10 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b 1073741824" returned: 0 in 0.556s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadd3f68-1f10-45b8-a72c-2366d6c1cbfd]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:10 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b Apr 13 17:51:10 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:10 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 Apr 13 17:51:10 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:10 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.453s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-9ab2ce2e-06e2-4930-b40e-8142bc56a291 None None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:10 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b" returned: 0 in 0.408s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.900s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288048245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31ab9fd-75df-42b0-a780-33fe7d60c054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6c335ca2c4ded83b1d6bd5e578e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:06Z,use_quota=True,user_id='0e0c18c945b447419ab7c46a73dee58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Creating volume a31ab9fd-75df-42b0-a780-33fe7d60c054 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:10 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65043e3-45d3-4ff8-adf7-f25454e4fc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46512fcf-9357-4f14-b604-5c821375bb8b', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:10 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 1073741824 Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8fe577-1a6c-4606-97fe-dc2f9218cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:10 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:10 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume volume-46512fcf-9357-4f14-b604-5c821375bb8b (46512fcf-9357-4f14-b604-5c821375bb8b): created successfully Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8fe577-1a6c-4606-97fe-dc2f9218cc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (362881ae-1148-4efe-8019-28f3264dc6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:10 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511" returned: 0 in 0.485s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:10 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:10 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2f41dab1-2b5b-43ba-af54-0110cc78a315 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created volume successfully. Apr 13 17:51:10 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511 Apr 13 17:51:10 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:11 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-c9d1de8e-7005-43f6-a647-3677941f8511" returned: 0 in 0.448s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-quobyte-c9d1de8e-7005-43f6-a647-3677941f8511" released by "delete_volume" :: held 0.970s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:11 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 1073741824" returned: 0 in 0.524s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Created reservations ['01a7dc22-3d15-49a9-8a7c-581b6bbb2ed8', '4bf4e577-c3f7-4a18-aa08-10060c8ed838', '27af9a0f-f563-40b8-9873-05d87b276c1d', '41c7686c-d712-40d7-a0d2-5cefcf52158e'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:11 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 Apr 13 17:51:11 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:11 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:11 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:11 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054" returned: 0 in 0.472s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.691s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-quobyte-05fd63d8-5c93-4975-b922-a6c711718dc2-a9b53303-defd-445e-ab65-d7e3754ed058" by "_create_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445e8363-7137-4248-b973-ca60ad653301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31ab9fd-75df-42b0-a780-33fe7d60c054', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec084703-af1a-4c7f-891c-f9f70d2d7916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-05fd63d8-5c93-4975-b922-a6c711718dc2-a9b53303-defd-445e-ab65-d7e3754ed058" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Creating volume a9b53303-defd-445e-ab65-d7e3754ed058 from snapshot 05fd63d8-5c93-4975-b922-a6c711718dc2 {{(pid=82736) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-quobyte-a9b53303-defd-445e-ab65-d7e3754ed058" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:11 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:11 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Volume volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 (a31ab9fd-75df-42b0-a780-33fe7d60c054): created successfully Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec084703-af1a-4c7f-891c-f9f70d2d7916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Flow 'volume_create_manager' (6c62f909-c10a-4d52-9d39-f52814582416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.485s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:11 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Deleted volume successfully. Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-a9b53303-defd-445e-ab65-d7e3754ed058" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] snapshot: 05fd63d8-5c93-4975-b922-a6c711718dc2, volume: a9b53303-defd-445e-ab65-d7e3754ed058, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:51:11 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-6c7be3cd-2303-4fb9-a303-aaf014aa4e5f tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created volume successfully. Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dca35cf4-76cf-4e3b-ab72-edfd38252fce tempest-CreateVolumesFromSnapshotTest-859567379 None] Lock "cinder-c9d1de8e-7005-43f6-a647-3677941f8511-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[a168bc0c-f40f-4c1a-ac2d-479d6580b479]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:11 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:11 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 Apr 13 17:51:11 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-a31ab9fd-75df-42b0-a780-33fe7d60c054-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-a31ab9fd-75df-42b0-a780-33fe7d60c054-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-quobyte-a31ab9fd-75df-42b0-a780-33fe7d60c054" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-a31ab9fd-75df-42b0-a780-33fe7d60c054" acquired by "delete_volume" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[51995778-a864-4aa2-937c-80c31d1022c1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:12 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 Apr 13 17:51:12 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:12 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2" returned: 0 in 0.562s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa324a67-4c7a-4e09-9a33-3291efee74f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6405f9c-d6b6-47f2-84cc-abbdd6cae2d9]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:12 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 Apr 13 17:51:12 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:12 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054" returned: 0 in 0.538s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:12 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054 Apr 13 17:51:12 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:12 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3" returned: 0 in 0.509s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:51:12 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:12 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 Apr 13 17:51:12 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Flow 'volume_create_manager' (c96477c1-3c39-4f21-8fa7-fc6d60286a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3488540c-bac1-4113-a040-d2c9abb4091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3488540c-bac1-4113-a040-d2c9abb4091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07b29212f9446b39b0c279872480468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:13Z,use_quota=True,user_id='5458941301664a6d8af653a4f3a33f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e23aa4e-8b77-4c60-9b69-c3c204f838e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e23aa4e-8b77-4c60-9b69-c3c204f838e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0557661-a237-4f30-8844-9f0dec5c19ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0557661-a237-4f30-8844-9f0dec5c19ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8', 'volume_name': 'volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83537b9-69f3-41df-9236-58c67da1624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83537b9-69f3-41df-9236-58c67da1624e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfde3f08-6a53-42f6-a935-9e4ee60d1a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:13 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Volume 9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8', 'volume_size': 1} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:13 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a31ab9fd-75df-42b0-a780-33fe7d60c054" returned: 0 in 0.477s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-a31ab9fd-75df-42b0-a780-33fe7d60c054" released by "delete_volume" :: held 1.043s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created reservations ['2dedf526-574a-4bbc-9974-3bc269c7c03f', '6a65257e-3035-4703-8112-de60687c9b61', 'fb33295b-a538-459d-a317-4c0e11c60a2d', 'a7feba38-f153-495d-a53b-90727db96074'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:13 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:13 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:13 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:14 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.913s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:14 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Deleted volume successfully. Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-af9f29cd-1afd-4268-a222-11d5ea557900 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-a31ab9fd-75df-42b0-a780-33fe7d60c054-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-46512fcf-9357-4f14-b604-5c821375bb8b-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-46512fcf-9357-4f14-b604-5c821375bb8b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-quobyte-46512fcf-9357-4f14-b604-5c821375bb8b" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-46512fcf-9357-4f14-b604-5c821375bb8b" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[289a4f19-72bf-4fbe-9cfa-ce4a7fb29b43]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:14 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b Apr 13 17:51:14 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:14 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058" returned: 0 in 2.122s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b509acb9-570c-4b70-a304-689448cd858c]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:14 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:15 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 Apr 13 17:51:15 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:15 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b" returned: 0 in 0.765s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:15 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b Apr 13 17:51:15 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:15 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3" returned: 0 in 0.582s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:51:15 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Converted 1024.00 MB image at 482.29 MB/s Apr 13 17:51:15 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 is being set with open permissions: ugo+rw Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:15 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 Apr 13 17:51:15 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:15 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-46512fcf-9357-4f14-b604-5c821375bb8b" returned: 0 in 0.400s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-46512fcf-9357-4f14-b604-5c821375bb8b" released by "delete_volume" :: held 1.199s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created reservations ['59480f90-029d-4170-a287-6f4b05ee1ac8', 'c25ae5d7-3e0b-4300-aa67-ab6f45ee7714', 'c134a62a-57d8-4af2-8cc0-62641d0c613d', 'ab14cd43-ad64-476a-abf9-969a1da5224c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:15 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:15 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:15 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058" returned: 0 in 0.405s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-a9b53303-defd-445e-ab65-d7e3754ed058" released by "_copy_volume_from_snapshot" :: held 4.248s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-05fd63d8-5c93-4975-b922-a6c711718dc2-a9b53303-defd-445e-ab65-d7e3754ed058" released by "_create_volume_from_snapshot" :: held 4.289s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.324s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.168s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1566204436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e006dde5b6b4d76a98da60b351b6d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:09Z,use_quota=True,user_id='5e3e16ca8d594b1bb513464d40b178b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Creating volume 4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:15 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:15 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:16 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff 1073741824 Apr 13 17:51:16 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6956103e-29fb-42ef-86fe-df7354e2def0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b53303-defd-445e-ab65-d7e3754ed058', 'volume_size': 1, 'snapshot_id': '05fd63d8-5c93-4975-b922-a6c711718dc2'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba1e804-5b15-4bac-ab61-26bbf04b059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:16 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Volume volume-a9b53303-defd-445e-ab65-d7e3754ed058 (a9b53303-defd-445e-ab65-d7e3754ed058): created successfully Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba1e804-5b15-4bac-ab61-26bbf04b059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Flow 'volume_create_manager' (8f50fd77-70c0-4b5c-8cd5-deb2fc28d39d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:16 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-b9ca15a5-f34e-42ac-b96c-83142e6f0ea4 tempest-SnapshotDependencyTests-1174190304 None] Created volume successfully. Apr 13 17:51:16 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.472s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:16 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Deleted volume successfully. Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8b7de785-0238-49cd-8a0d-cb98fe0d9fda tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-46512fcf-9357-4f14-b604-5c821375bb8b-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-05fd63d8-5c93-4975-b922-a6c711718dc2-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-05fd63d8-5c93-4975-b922-a6c711718dc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-quobyte-aa324a67-4c7a-4e09-9a33-3291efee74f3" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-aa324a67-4c7a-4e09-9a33-3291efee74f3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-quobyte-05fd63d8-5c93-4975-b922-a6c711718dc2" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-05fd63d8-5c93-4975-b922-a6c711718dc2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Deleting offline snapshot 05fd63d8-5c93-4975-b922-a6c711718dc2 of volume aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] snapshot_file for this snap is: volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd1dc93-46d0-439e-874f-b8809c1b0d4b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:16 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 Apr 13 17:51:16 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:16 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff 1073741824" returned: 0 in 0.586s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:16 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff Apr 13 17:51:16 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-1fc40ba1-b8ef-4bc1-aef6-a458d867a527-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-1fc40ba1-b8ef-4bc1-aef6-a458d867a527-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-quobyte-1fc40ba1-b8ef-4bc1-aef6-a458d867a527" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-1fc40ba1-b8ef-4bc1-aef6-a458d867a527" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecc196f-2412-4ced-92ac-75e327905982]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:16 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:16 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 Apr 13 17:51:16 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:17 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2" returned: 0 in 0.533s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa324a67-4c7a-4e09-9a33-3291efee74f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de404d9-f6c2-4bfd-82af-939402da4fa1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:17 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" returned: 0 in 0.441s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.912s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07b29212f9446b39b0c279872480468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:13Z,use_quota=True,user_id='5458941301664a6d8af653a4f3a33f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Creating volume 9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:17 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223b0a9f-ab65-4064-ae35-2a481e320e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193126b1-62b6-4942-8ada-2b39f2992843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:17 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 1073741824 Apr 13 17:51:17 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:17 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Volume volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff (4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff): created successfully Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193126b1-62b6-4942-8ada-2b39f2992843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Flow 'volume_create_manager' (e8b3cbee-dc10-4468-85fa-184b5aba165a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:17 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-4caf2213-4062-47ab-8aed-8e19d8eb5347 tempest-VolumeDependencyTests-2020647289 None] Created volume successfully. Apr 13 17:51:17 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 Apr 13 17:51:17 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:17 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527" returned: 0 in 0.528s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:17 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527 Apr 13 17:51:17 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Flow 'volume_create_manager' (de78a762-85f5-4d15-894e-559b2848f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41c05dd-b741-4b92-a2d5-bb0336e83891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41c05dd-b741-4b92-a2d5-bb0336e83891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1159625543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23395c7-d3c8-4fbf-864b-f1c9359fa86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e006dde5b6b4d76a98da60b351b6d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:18Z,use_quota=True,user_id='5e3e16ca8d594b1bb513464d40b178b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e57c037-a97d-4a87-b164-a0fc4e7bde3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e57c037-a97d-4a87-b164-a0fc4e7bde3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2738849-4243-4c42-968d-8089d15917b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2738849-4243-4c42-968d-8089d15917b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f23395c7-d3c8-4fbf-864b-f1c9359fa86b', 'volume_name': 'volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b', 'volume_size': 1, 'source_volid': '4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff', 'source_volstatus': 'available'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e08a52-37a6-47ed-aeef-988576dcd551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e08a52-37a6-47ed-aeef-988576dcd551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:17 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593a8885-bafe-40ae-b40f-dd8248bdde2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:17 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Volume f23395c7-d3c8-4fbf-864b-f1c9359fa86b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b', 'volume_size': 1, 'source_volid': '4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff', 'source_volstatus': 'available'} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 1073741824" returned: 0 in 0.614s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:17 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3" returned: 0 in 0.660s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:17 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 Apr 13 17:51:17 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:17 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 Apr 13 17:51:17 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:17 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-1fc40ba1-b8ef-4bc1-aef6-a458d867a527" returned: 0 in 0.515s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-1fc40ba1-b8ef-4bc1-aef6-a458d867a527" released by "delete_volume" :: held 1.076s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created reservations ['9b4c2961-e298-4051-b987-87c5cf94599b', 'a74dfaad-27f5-4f5d-beb6-58939da40e83', '22bf41e0-93e7-4f4f-be34-653a75dd08ac', '88dd886c-88dc-4d04-af3e-800634eaea10'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:17 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:17 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:17 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:18 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8" returned: 0 in 0.431s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.461s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:18 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Cloning volume 4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff to volume f23395c7-d3c8-4fbf-864b-f1c9359fa86b Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfde3f08-6a53-42f6-a935-9e4ee60d1a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb29b537-f250-4334-8ebd-f05a8b42a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:18 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:18 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Volume volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 (9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8): created successfully Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb29b537-f250-4334-8ebd-f05a8b42a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Flow 'volume_create_manager' (c96477c1-3c39-4f21-8fa7-fc6d60286a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Creating offline snapshot 6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba of volume 4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2" returned: 0 in 0.522s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-a74affcf-4b1e-44cb-84c5-24677437f389 tempest-CinderUnicodeTest-1870472335 None] Created volume successfully. Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[329d98e2-abed-4430-b9d9-54d106bd132d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:18 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2 Apr 13 17:51:18 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:18 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff Apr 13 17:51:18 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:18 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.451s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Deleted volume successfully. Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-f92e54a1-4b47-4737-96b7-4b20b7e28d25 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-1fc40ba1-b8ef-4bc1-aef6-a458d867a527-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82736) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 13 17:51:18 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:18 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Flow 'volume_create_manager' (3bc38c34-8908-4126-b859-4888185e0372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0dbb75-7eff-473b-91ae-bb5fe8ee94b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3.05fd63d8-5c93-4975-b922-a6c711718dc2" returned: 0 in 0.522s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" returned: 0 in 0.510s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:18 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba 1G Apr 13 17:51:18 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0dbb75-7eff-473b-91ae-bb5fe8ee94b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1299465113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3625b2d-9541-48c5-9665-8fcd00c3f24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07b29212f9446b39b0c279872480468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:19Z,use_quota=True,user_id='5458941301664a6d8af653a4f3a33f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f90ba6-1e92-4d6e-90f3-56a8ed3f6af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f90ba6-1e92-4d6e-90f3-56a8ed3f6af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fe622a-92d7-4ebf-882a-02c20b6b16e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fe622a-92d7-4ebf-882a-02c20b6b16e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3625b2d-9541-48c5-9665-8fcd00c3f24c', 'volume_name': 'volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d138dc-2478-4eab-9141-5b97620e9c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d138dc-2478-4eab-9141-5b97620e9c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155fb6c6-531b-41fa-ab7c-919949f27bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:18 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Volume e3625b2d-9541-48c5-9665-8fcd00c3f24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c', 'volume_size': 1} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-05fd63d8-5c93-4975-b922-a6c711718dc2" released by "_delete_snapshot" :: held 2.338s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-aa324a67-4c7a-4e09-9a33-3291efee74f3" released by "delete_snapshot" :: held 2.354s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Created reservations ['aa7ee822-8691-453c-8cd2-96644d268c8c', 'ec1a88b2-c0e9-49aa-80f5-0f0f27412de5', '3fe935ea-d677-417b-b727-09872d224273', '2523edfc-e189-4092-843b-0f4ffa0feb98'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:18 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Delete snapshot completed successfully. Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2b743929-adae-4c0c-a590-d2493e1e352f tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-05fd63d8-5c93-4975-b922-a6c711718dc2-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-quobyte-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d37294-94a4-4215-bacd-8a1932c6e5e5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:18 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:19 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 Apr 13 17:51:19 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:19 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba 1G" returned: 0 in 0.489s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:19 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba Apr 13 17:51:19 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:19 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78" returned: 0 in 0.494s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:19 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78 Apr 13 17:51:19 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-aa324a67-4c7a-4e09-9a33-3291efee74f3-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-aa324a67-4c7a-4e09-9a33-3291efee74f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-quobyte-aa324a67-4c7a-4e09-9a33-3291efee74f3" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-aa324a67-4c7a-4e09-9a33-3291efee74f3" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddb5df0-010a-4375-bcd8-d256a2588ede]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:19 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" returned: 0 in 0.500s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:19 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba is being set with open permissions: ugo+rw Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:19 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba Apr 13 17:51:19 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:19 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 Apr 13 17:51:19 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:19 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78" returned: 0 in 0.482s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78" released by "delete_volume" :: held 1.006s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:19 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created reservations ['aa401093-ae03-48f7-a952-ecabb817e3de', 'ba74c08f-f725-49ba-aa28-f3e7483cb260', '6461bb63-b603-4563-99cc-361e5c74bf30', '978d0b00-895f-4239-83f2-f3b110d060ea'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:20 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:20 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:20 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" returned: 0 in 0.445s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:20 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.info Apr 13 17:51:20 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:20 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3" returned: 0 in 0.521s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:20 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3 Apr 13 17:51:20 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:20 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.448s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:20 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Deleted volume successfully. Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-1f068502-2b14-4db3-ae75-c0bce3456054 tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-5dbb4c3a-d007-4ed4-bc4d-2dafd34a5b78-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:20 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.info" returned: 0 in 0.425s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:20 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.info is being set with open permissions: ugo+rw Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:20 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.info Apr 13 17:51:20 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:20 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-aa324a67-4c7a-4e09-9a33-3291efee74f3" returned: 0 in 0.426s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-aa324a67-4c7a-4e09-9a33-3291efee74f3" released by "delete_volume" :: held 0.994s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Created reservations ['6d4ceb66-83ce-412c-a91c-5ff296230f43', '81408b2b-9ecc-4a33-a3f9-58ba3f3007b6', '1a4a8736-ca96-4d8c-8a5b-37f903327f9f', '640f99bd-1ec2-4857-a830-77ea80d1ff86'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:20 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:20 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:20 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-7eac478b-2bb6-42e3-9124-03e87bab4d4b-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-7eac478b-2bb6-42e3-9124-03e87bab4d4b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:21 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.info" returned: 0 in 0.499s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" by "_copy_volume_from_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] snapshot: 6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba, volume: f23395c7-d3c8-4fbf-864b-f1c9359fa86b, {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b18039-17fb-45f8-b0cc-b1e1b5b949e5]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:21 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-quobyte-7eac478b-2bb6-42e3-9124-03e87bab4d4b" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.438s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:21 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Deleted volume successfully. Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-7eac478b-2bb6-42e3-9124-03e87bab4d4b" acquired by "delete_volume" :: waited 0.021s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[525fd8a4-a21d-41c8-8cc4-c75ea1fd3589]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-352a19cb-a674-4e45-bb76-7b20389249ea tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-aa324a67-4c7a-4e09-9a33-3291efee74f3-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:21 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba Apr 13 17:51:21 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:21 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b Apr 13 17:51:21 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:21 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" returned: 0 in 0.508s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Creating direct copy from snapshot {{(pid=82736) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3235a0-be73-4357-bff6-790be055802b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:21 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b" returned: 0 in 0.502s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:21 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b Apr 13 17:51:21 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:21 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff Apr 13 17:51:21 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-a9b53303-defd-445e-ab65-d7e3754ed058-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-a9b53303-defd-445e-ab65-d7e3754ed058-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "cinder-quobyte-a9b53303-defd-445e-ab65-d7e3754ed058" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-a9b53303-defd-445e-ab65-d7e3754ed058" acquired by "delete_volume" :: waited 0.012s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8502533e-f776-4f8e-93c4-fdca2a6b2192]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:21 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:21 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 Apr 13 17:51:21 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:22 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7eac478b-2bb6-42e3-9124-03e87bab4d4b" returned: 0 in 0.450s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-7eac478b-2bb6-42e3-9124-03e87bab4d4b" released by "delete_volume" :: held 0.985s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created reservations ['7a36f1d3-2716-4aa9-8d4b-a6e5240360b9', '15f07885-d2c2-4b4d-a62b-55df810f3e91', 'b21e0deb-4290-43f2-ad95-269e2e2bdfee', '99c90bce-4118-4b5a-9c83-c5f587f05bb5'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:22 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" returned: 0 in 0.540s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG cinder.utils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Path /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b not found in is_blk_device check {{(pid=82736) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:22 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b Apr 13 17:51:22 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:22 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:22 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:22 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058" returned: 0 in 0.513s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:22 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058 Apr 13 17:51:22 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:22 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-a9b53303-defd-445e-ab65-d7e3754ed058" returned: 0 in 0.475s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-quobyte-a9b53303-defd-445e-ab65-d7e3754ed058" released by "delete_volume" :: held 1.028s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:22 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Created reservations ['3e544cb9-c317-4e13-89ba-f9bb6f02c290', '4147d6ce-8ec4-40b2-8177-e0aefa475cc3', 'c17f8577-c720-451f-aa38-3d45902ed4ac', '40edb68e-ca64-48ca-ba09-c8863262b2f7'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:22 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.718s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:23 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Deleted volume successfully. Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-13ac5515-03dc-4900-bc38-e6b77a95a6ab tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-7eac478b-2bb6-42e3-9124-03e87bab4d4b-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:23 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:23 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "cinder-quobyte-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd253a5e-811e-44c9-adb6-7b9f87978231]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:23 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:23 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a Apr 13 17:51:23 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:24 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 1.241s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:24 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:24 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Deleted volume successfully. Apr 13 17:51:24 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-8af58f4f-5978-4689-85d2-bbf45b8f3870 tempest-SnapshotDependencyTests-1174190304 None] Lock "cinder-a9b53303-defd-445e-ab65-d7e3754ed058-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:24 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" returned: 0 in 2.243s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:24 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a3d271-aa49-4ad7-a9a1-0dcc064ef664]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:24 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff Apr 13 17:51:24 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:24 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a" returned: 0 in 1.191s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:24 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:24 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a Apr 13 17:51:24 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:25 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a" returned: 0 in 0.417s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-quobyte-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a" released by "delete_volume" :: held 1.644s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Created reservations ['f2ca6bb9-8324-4b6c-b92b-f823f93aff01', '5c623228-1ce7-4899-834f-a6f4a8c83486', '70043b9c-2275-4414-8e4b-b9825687b99b', '1486491f-1a5b-4966-a5fb-90e8f4f3e103'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:25 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" returned: 0 in 0.637s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.image.image_utils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Image conversion details: src /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b {{(pid=82736) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 17:51:25 devstack cinder-volume[82736]: INFO cinder.image.image_utils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Converted 1024.00 MB image at 456.29 MB/s Apr 13 17:51:25 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b is being set with open permissions: ugo+rw Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:25 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:25 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:25 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:25 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:25 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" returned: 0 in 0.470s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" released by "_copy_volume_from_snapshot" :: held 4.456s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Deleting offline snapshot 6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba of volume 4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] snapshot_file for this snap is: volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b3000-c766-495e-87fe-4d6cd4f385d7]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:25 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.505s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:25 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Deleted volume successfully. Apr 13 17:51:25 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-3d7b354a-8186-4913-bc8b-1970d738073b tempest-CreateVolumesFromSourceVolumeTest-842303507 None] Lock "cinder-08c29f1c-b411-4a6c-9de3-bfc1b1f1106a-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:25 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba Apr 13 17:51:25 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:26 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" returned: 0 in 0.612s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:26 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:51:26 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aa1f1b-7f16-43a3-b345-152abe6681c8]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:26 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff Apr 13 17:51:26 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:26 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" returned: 0 in 0.589s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:26 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:26 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba Apr 13 17:51:26 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:27 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" returned: 0 in 0.521s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:27 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba Apr 13 17:51:27 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:27 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff.6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" returned: 0 in 0.481s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-6e5e8b9a-8d17-4902-9c37-a2f778a0a2ba" released by "_delete_snapshot" :: held 2.258s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.777s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.122s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T15:51:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1299465113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3625b2d-9541-48c5-9665-8fcd00c3f24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07b29212f9446b39b0c279872480468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:51:19Z,use_quota=True,user_id='5458941301664a6d8af653a4f3a33f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1bf2174-bf87-4e55-bbdb-985ff01bfae2),volume_type_id=d1bf2174-bf87-4e55-bbdb-985ff01bfae2)}" {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Creating volume e3625b2d-9541-48c5-9665-8fcd00c3f24c {{(pid=82736) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Selected osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea as target Quobyte volume. {{(pid=82736) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 17:51:27 devstack cinder-volume[82736]: INFO cinder.volume.drivers.remotefs [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] casted to osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c 1073741824 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593a8885-bafe-40ae-b40f-dd8248bdde2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b', 'volume_size': 1, 'source_volid': '4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff', 'source_volstatus': 'available'}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:27 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c 1073741824 Apr 13 17:51:27 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def82905-a81d-459a-b553-b9119ca183ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:27 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Volume volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b (f23395c7-d3c8-4fbf-864b-f1c9359fa86b): created successfully Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def82905-a81d-459a-b553-b9119ca183ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:27 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Flow 'volume_create_manager' (de78a762-85f5-4d15-894e-559b2848f365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:27 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-c7feafbc-9ddc-4aeb-be2a-9da75833ed86 tempest-VolumeDependencyTests-2020647289 None] Created volume successfully. Apr 13 17:51:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:28 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" acquired by "delete_volume" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:28 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[390fb170-5a6a-47e8-89ca-ae147803954b]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:28 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff Apr 13 17:51:28 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:28 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c 1073741824" returned: 0 in 0.610s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:28 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:28 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c Apr 13 17:51:28 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:29 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" returned: 0 in 0.534s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:29 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c" returned: 0 in 0.464s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'} {{(pid=82736) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:29 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff Apr 13 17:51:29 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155fb6c6-531b-41fa-ab7c-919949f27bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c', 'volume_size': 1}' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b02997-a1d2-4ef1-b257-4cea5db0d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 17:51:29 devstack cinder-volume[82736]: INFO cinder.volume.flows.manager.create_volume [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Volume volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c (e3625b2d-9541-48c5-9665-8fcd00c3f24c): created successfully Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b02997-a1d2-4ef1-b257-4cea5db0d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82736) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Flow 'volume_create_manager' (3bc38c34-8908-4126-b859-4888185e0372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82736) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 17:51:29 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-d3715b01-7d2f-4989-8610-6ba21baef7dd tempest-CinderUnicodeTest-1870472335 None] Created volume successfully. Apr 13 17:51:29 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" returned: 0 in 0.423s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff" released by "delete_volume" :: held 0.987s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Created reservations ['2125d987-046a-435b-a069-035ad55c212d', 'db25b317-fe35-4778-9903-faeeff595036', 'b5c1aec9-ee63-4c39-8af6-a593a34d6dc5', '3de105a9-30b2-4f13-8858-ffce2d8df65a'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:29 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:29 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Creating offline snapshot 57e3291b-a9c4-4c99-a7dd-2d2684754000 of volume e3625b2d-9541-48c5-9665-8fcd00c3f24c {{(pid=82736) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[f587bfa9-805d-40cc-b6b1-01f7295fa454]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:29 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:29 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c Apr 13 17:51:29 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:30 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.515s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:30 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Deleted volume successfully. Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-dc412f68-450b-4d1e-bf61-cbbfc7912c2e tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-4f60c73e-dd1f-4c08-b8eb-8aa82095f1ff-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:30 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c" returned: 0 in 0.569s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 1G {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:30 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 1G Apr 13 17:51:30 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-f23395c7-d3c8-4fbf-864b-f1c9359fa86b-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-f23395c7-d3c8-4fbf-864b-f1c9359fa86b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" acquired by "delete_volume" :: waited 0.006s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e282734-11d9-403f-809a-341cb5fad0af]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:30 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b Apr 13 17:51:30 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:30 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 1G" returned: 0 in 0.557s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:30 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:30 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 Apr 13 17:51:30 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:31 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" returned: 0 in 0.577s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:31 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b Apr 13 17:51:31 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:31 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c -F qcow2 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000" returned: 0 in 0.505s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:31 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 is being set with open permissions: ugo+rw Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:31 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 Apr 13 17:51:31 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:31 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" returned: 0 in 0.453s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-f23395c7-d3c8-4fbf-864b-f1c9359fa86b" released by "delete_volume" :: held 1.056s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Created reservations ['1fd8a9b0-c96d-4566-97ce-dc93c83a7444', '9c94ad11-4869-45a1-8de2-1d1a80738196', '3c300ad9-2a02-4fae-8fb8-5a22505786fd', '93d263a9-6704-4028-8888-259483330172'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:31 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:31 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:31 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000" returned: 0 in 0.504s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:31 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:31 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.info Apr 13 17:51:31 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:32 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.410s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:32 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Deleted volume successfully. Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-2f3b864d-36cd-4479-9d21-e75bb7787596 tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-f23395c7-d3c8-4fbf-864b-f1c9359fa86b-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:32 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.info" returned: 0 in 0.424s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:32 devstack cinder-volume[82736]: WARNING cinder.volume.drivers.remotefs [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.info is being set with open permissions: ugo+rw Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.info {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:32 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.info Apr 13 17:51:32 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:32 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.info" returned: 0 in 0.406s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:32 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-77408a1f-f321-4d2a-b170-5eafc6bc35f2 tempest-CinderUnicodeTest-1870472335 None] Create snapshot completed successfully Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-7a1bc454-74a2-43ff-ae52-ca43710782a9-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-7a1bc454-74a2-43ff-ae52-ca43710782a9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "cinder-quobyte-7a1bc454-74a2-43ff-ae52-ca43710782a9" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-7a1bc454-74a2-43ff-ae52-ca43710782a9" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "cinder-57e3291b-a9c4-4c99-a7dd-2d2684754000-delete_snapshot" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[22624a38-410f-43a1-9ed7-750bf22be4b4]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-57e3291b-a9c4-4c99-a7dd-2d2684754000-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "cinder-quobyte-e3625b2d-9541-48c5-9665-8fcd00c3f24c" by "delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-quobyte-e3625b2d-9541-48c5-9665-8fcd00c3f24c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "cinder-quobyte-57e3291b-a9c4-4c99-a7dd-2d2684754000" by "_delete_snapshot" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-quobyte-57e3291b-a9c4-4c99-a7dd-2d2684754000" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Deleting offline snapshot 57e3291b-a9c4-4c99-a7dd-2d2684754000 of volume e3625b2d-9541-48c5-9665-8fcd00c3f24c {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] snapshot_file for this snap is: volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 {{(pid=82736) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0198ea-c615-4d7b-b794-d1609588815d]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:32 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:32 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 Apr 13 17:51:32 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:33 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 Apr 13 17:51:33 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:33 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9" returned: 0 in 0.495s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:33 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9 Apr 13 17:51:33 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:33 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000" returned: 0 in 0.496s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.remotefs [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82736) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b6be50-37ad-467b-859f-7f8dae79f482]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:33 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c Apr 13 17:51:33 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:33 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-7a1bc454-74a2-43ff-ae52-ca43710782a9" returned: 0 in 0.427s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-quobyte-7a1bc454-74a2-43ff-ae52-ca43710782a9" released by "delete_volume" :: held 0.949s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Created reservations ['247da915-8784-4e30-ab54-f352c26ab4af', '28c893f7-d029-477e-a864-c42d08e7fdf7', 'e555dd63-beeb-4a06-8daa-7d6b149c3d39', 'd283cdeb-8c25-49cc-b2a7-45bd048870e6'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:33 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:33 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:33 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c" returned: 0 in 0.517s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:33 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:34 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 Apr 13 17:51:34 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:34 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.523s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:34 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:34 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Deleted volume successfully. Apr 13 17:51:34 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-5ad76767-1b04-4cf0-9418-6005c29e76da tempest-VolumeDependencyTests-2020647289 None] Lock "cinder-7a1bc454-74a2-43ff-ae52-ca43710782a9-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:34 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000" returned: 0 in 0.556s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:34 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:34 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000 Apr 13 17:51:34 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:35 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:35 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c.57e3291b-a9c4-4c99-a7dd-2d2684754000" returned: 0 in 0.530s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-quobyte-57e3291b-a9c4-4c99-a7dd-2d2684754000" released by "_delete_snapshot" :: held 2.165s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-quobyte-e3625b2d-9541-48c5-9665-8fcd00c3f24c" released by "delete_snapshot" :: held 2.178s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:35 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Created reservations ['d96e30b6-9e63-4478-abad-ec0d6a8f9515', '70265950-a589-4f16-aaae-a09bc714551a', '0bfd492f-71b4-44dc-9c57-4bbfe7df47c9', 'cf947a5a-36d2-44c9-932a-c6b262e66a6c'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:35 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Delete snapshot completed successfully. Apr 13 17:51:35 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-e3343d60-2c23-4f17-afcd-1fe5007b3101 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-57e3291b-a9c4-4c99-a7dd-2d2684754000-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "cinder-e3625b2d-9541-48c5-9665-8fcd00c3f24c-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-e3625b2d-9541-48c5-9665-8fcd00c3f24c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "cinder-quobyte-e3625b2d-9541-48c5-9665-8fcd00c3f24c" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-quobyte-e3625b2d-9541-48c5-9665-8fcd00c3f24c" acquired by "delete_volume" :: waited 0.010s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2b2038-97dc-4b15-b152-77d6213298d1]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:36 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c Apr 13 17:51:36 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:36 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c" returned: 0 in 0.487s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:36 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c Apr 13 17:51:36 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:36 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:36 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-e3625b2d-9541-48c5-9665-8fcd00c3f24c" returned: 0 in 0.388s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-quobyte-e3625b2d-9541-48c5-9665-8fcd00c3f24c" released by "delete_volume" :: held 0.919s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:SELECT=212,cinder:UPDATE=285,cinder:INSERT=75,cinder:DELETE=25 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Created reservations ['3bdc88d7-d1dc-44e3-89e1-20ba33325003', '08a0693b-f37a-42c2-aeb7-e7b9a06ace8b', '01cd79ec-1170-4ee1-a248-1e931b749457', '2770770d-1442-4869-8b98-3fef6e0af15b'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:37 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:37 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "cinder-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8-delete_volume" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "cinder-quobyte-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8" by "delete_volume" {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-quobyte-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8" acquired by "delete_volume" :: waited 0.011s {{(pid=82736) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a134013-2d66-4c66-bc03-9bd882bfd396]: (4, 'qcow2') {{(pid=84160) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:37 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 Apr 13 17:51:37 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:37 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.451s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:37 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Deleted volume successfully. Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-ce8799c8-bc63-4ca7-8d32-e2e71fcf272c tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-e3625b2d-9541-48c5-9665-8fcd00c3f24c-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:37 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8" returned: 0 in 0.499s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:37 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:37 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8 Apr 13 17:51:37 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:38 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830/volume-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8" returned: 0 in 0.383s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-quobyte-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8" released by "delete_volume" :: held 0.917s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:UPDATE=289,cinder:DELETE=27,cinder:SELECT=204,cinder:INSERT=63 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG cinder.quota [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Created reservations ['5d840000-7723-4bcc-b427-dfe9513426da', '72f36490-ceca-4e42-b101-958780f28f06', '4fe5b9ac-539e-41ce-b9ed-969228d5a960', '10b75223-5c47-4f22-8551-795bf2b80f58'] {{(pid=82736) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea': None} {{(pid=82736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG cinder.volume.drivers.quobyte [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbb1a169-bb0d-4ad3-b05c-6ee644807dea'] {{(pid=82736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.lockutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82736) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 17:51:38 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830 Apr 13 17:51:38 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 17:51:38 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG oslo_concurrency.processutils [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3e61a86634c3b7514c260b55f851b830" returned: 0 in 0.468s {{(pid=82736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG cinder.manager [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Notifying Schedulers of capabilities ... {{(pid=82736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 17:51:38 devstack cinder-volume[82736]: INFO cinder.volume.manager [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Deleted volume successfully. Apr 13 17:51:38 devstack cinder-volume[82736]: DEBUG cinder.coordination [None req-197992e4-0cd9-467e-bc9c-7b0ac7e9f3c6 tempest-CinderUnicodeTest-1870472335 None] Lock "cinder-9ab03a8b-8d11-4f6f-ac74-b9be6e88ecb8-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82736) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 17:51:48 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 17:51:48 devstack cinder-volume[82736]: DEBUG dbcounter [-] [82736] Writing DB stats cinder:INSERT=6,cinder:UPDATE=17,cinder:SELECT=5,cinder:DELETE=1 {{(pid=82736) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}